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“esearch  in  the  field  of  judgment  and  decision  making  often  compares  the 
rationality  of  a  person's  intuitive  judgments  under  uncertainty  with 
analytically  derived  answers  produced  by  a  formal  model  such  as  Bayes' 

Theorem,  a  multiple  regression  equation,  or  other  rules  from  the  conventional 
probability  calculus  (for  reviews  see  Einhorn  &  Hogarth,  1981;  Hammond, 
McClelland,  &  Mumpower,  1980;  Jungermann,  1963;  Kahneman,  Slovic,  &  Tversky, 
1982;  litz  &  Sachs,  1984;.  Such  comparisons  are  indirect:  they  compare  a 
person's  intuitive  efforts  with  person-independent  operations.  That  is,  they 
compare  a  person's  intuitive  processes  and  judcpients  with  those  of  an 
analytically-derived  rule  or  equation  put  forward  as  a  standard  of 
rationality.  Indirect  comparisons  are  undeniably  important,  but  they  are 
necessarily  restricted  in  three  ways.  First,  because  indirect  comparisons 
evaluate  intuition  with  respect  to  a  standard  of  rationality,  researchers  must 
choose  some  standard  from  among  the  many  offered.  But  agreement  on  which 
standard  of  rationality  is  correct  has  never  been  achieved.  The  choice  of  any 
standard,  therefore,  is  subject  to  dispute,  and  any  conclusions  drawn 
regarding  the  failure  of  subjects  to  achieve  the  standard  choBen  are  sure  to 
be  criticized  by  those  who  prefer  a  different  standard  (as  indeed  they  have 
been;  see  Cohen,  1981;  Kyberg,  1963;  also  Einhorn  6  Hogarth,  1981). 

Second,  the  results  of  indirect  comparisons  cannot  fail  to  show  that 
analytical  cognition  is  equal  or  superior  to  intuitive  cognition  because 
analytical  models,  however  chosen,  provide  the  standard  to  be  achieved  by 
persons.  If  Intuition  offers  an  advantage  over  analysis,  as  many  have  argued 
it  does,  its  putative  advantage  cannot  be  demonstrated  in  indirect  comparisons 
because  the  analytical  mo>iel  provides  a  ceiling.  Therefore  it  is  not 
altogether  surprising  that  populational  studies  find  that  few  persons' 
intuitive  efforts  achieve  the  standard  (Kahneman  et  al.,  1982)  and  none  exceed 


it 
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Third,  when  indirect  comparisons  are  made,  the  analytical  models  are 
always  provided  with  all  the  correct  (and  only  the  correct)  substantive 
information  each  model  requires.  And  such  models  are  (almost)  always  executed 
without  error--at  least  in  academic  journals.  In  practice,  however, 
analytical  cognition,  as  distinct  from  models  of  it,  is  vulnerable  to 
substantive  failures  (insufficient  information,  incorrect  information, 
incorrect  substantive  theory,  insufficient  time)  and  procedural  failures 
(incorrect  assignment  of  numbers  to  the  symbols  of  the  equation,  computational 
errors,  use  of  an  incorrect  model).  In  short,  valuable  as  work  on  indirect 
comparisons  may  be,  these  restrictions  prevent  them  from  informing  us  about 
the  relative  efficacy  of  intuitive  and  analytical  cognition  as  practiced  by 
persons. 

Therefore  direct  comparisons  between  a  person’s  use  of  intuition  and  the 
same  person's  use  of  analysis  are  also  needed.  Direct  comparisons  will  inform 
us  about  the  relative  efficacy  of  these  ~>odes  of  cognition  in  terms  of 
empirical  achievement  or  correctness.  Comparisons  of  relative  efficacy, 
however,  require  the  presence  of  an  empirical  criterion  with  which  judgments 
are  compared,  rather  than  a  standard  of  rationality.  When  such  criteria  are 
available  direct  comparisons  enable  us  to  address  the  age-old  question:  Does 
a  person's  intuitive  or  analytical  cognition  produce  more  empirically  accurate 
answers?  (See  Einhorn  &  Hogarth,  1981,  for  parallel  remarks;  see  also  their 
stimulating  discussion  of  "accuracy  vs.  truth",  1982.)  The  work  described 
balow  makes  direct  comparisons  of  the  relative  efficacy  of  intuitive  and 
analytical  modes  of  cognition  in  the  context  of  a  study  of  expert  judgment. 
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Premises 

Our  approach  rejects  the  traditional  dichotomy  between  intuition  and 
analysis.  It  is  based  on  the  premise  that  both  cognitive  processes  and  task 
conditions  can  be  arranged  .  i  a  continuum  that  run;,  from  intuition  to  analysis 
( Hammond  &  Erehmer,  1973,  p.  340;  see  also  Hammond,  1955,  1966,  1982; 
Erunswik,  1956;  Goldsbcrry,  1983).  Furthermore,  once  cognitive  processes  are 
defined  in  terms  of  their  location  on  a  cognitive  continuum,  they  will  be 
found  to  interact  in  predictable  ways  with  various  task  conditions  located  on 
a  similar  continuum.  Goldsberry  (1983)  found  confirmatory  results  in  the 
initial  test  of  that  prediction.  The  present  study  extends  the  test  of  the 
validity  of  that  prediction. 

The  above  premise  and  prediction  follow  directly  from  the  Brunswikian 
tradition  of  systematically  examining  task  characteristics  as  determiners  of 
behavior,  a  tradition  that  ic  receiving  increasing  support  from  contemporary 
researchers .  For  example.  Beach  and  Mitchell  (1978),  Einhorn  and  Hogarth 
(1931),  Payne  (1982),  and  Howell  and  Xerkar  (1982)  have  reiterated  the  need 
for  further  systematic  analysis  of  the  effects  of  task  properties  on  cognitive 
processes.  Hoch  and  Tschirgi  (1983)  provide  an  excellent  example  of  the  use 
of  the  Branr.wikian  framework  for  comparing  cognitive  activity  with  an 
analytical  modal  of  deductive  reasoning.  They  'show  that  the  "confirmation 
bias'-  produced  when  subjects  attempt  to  solve  deductive  problems  presented  in 
abstract  form  (Wason  &  Johnson-Laird,  1972)  largely  disappears  when  the  task 
is  permitted  to  include  cue  redundancy  (an  important  aspect  of  Brunswik's 
representative  design),  thus  at  once  restricting  the  previous 
over- generalization  and  extending  our  knowledge  to  tasks  representing  those 
more  likely  to  be  encountered. 
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Theoretical  Background 

Direct  (and  indirect)  comparisons  of  different  modes  of  cognition  require 
not  only  a  theory  of  cognition  but  a  theory  of  context  as  well,  unless  the 
cognitive  theory  claims  universal  generality  over  tasks.  Since  we  reject  the 
traditional  premise  of  a  dichotomy  between  intuition  and  analysis  and  posit  a 
continuum  instead,  the  continuum  theory  must,  first,  provide  a  set  of 
descriptive  terms  that  will  make  it  possible  to  denote  the  location  of  a 
person's  cognitive  activity  on  the  cognitive  continuum;  second,  provide  a  set 
of  descriptive  terms  that  will  enable  us  to  denote  the  location  of  a  task  on  a 
task  continuum  according  to  the  hypothesized  ability  of  the  task  to  induce 
cognition  to  be  activated  at  a  predicted  region  on  the  cognitive  continuum; 
and  third,  indicate  the  consequences  of  the  correspondence  between  task 
location  and  cognitive  location  for  various  behaviors,  such  as  the  accuracy  of 
judgments .  Without  an  attempt  to  provide  a  priori  a  reasonably  complete  set 
of  descriptors  of  both  task  properties  and  cognitive  properties,  any  cognitive 
theory  is  apt  to  provide  predictions  of  behavior  difficult  to  falsify. 

Descriptors  for  Modes  of  Cognition 

Researchers  in  cognition  almost  never  explain  what  they  mean  by 
Intuition,  although  they  take  great  pains  to  differentiate  precisely  among 
formal,  analytical  models  of  cognition.  An  a  result,  it  is  customary  to 
define  intuition  in  terms  of  what  it  is  not.  Brooks  ! 1978) ,  for  example, 
compares  "analytical  and  nonanalytlcal  concept  formation",  and  Beach  and 
Mitchell  (1978)  refer  to  "nonanalytical  strategies”  (emphasis  ours).  And 
Kahneman  and  Tverksy  (1982)  indicate  that  "a  judgment  is  called  intuitive  if 
it  is  reached  by  an  informal  and  unstructured  mode  of  reasoning,  without  the 
use  of  analytical  methods  or  deliberate  calculations"  (emphasis  ours).  Even 
philosophers  (e.g.,  Cohen,  1981)  who  criticize  psychological  research  on 
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judgments  fail  to  say  what  they  mean  by  intuition.  In  an  effort  to  specify 
meaning,  we  provide  a  list  of  descriptors  that  apply  to  intuition  as  well  as 
analysis . 

According  to  cognitive  continuum  theory,  intuition  and  analysis  can  be 
distinguished  by  the  degree  of  the  subject's:  (a)  cognitive  control  (in 
intuition,  low?  in  analysis,  high);  (b)  rate  of  data  processing  (in 
intuition,  rapid,  i.e.,  as  brief  as  microseconds;  in  analysis,  slow,  i.e.,  as 
long  as  hours,  days,  or  years);  (c)  conscious  awareness  of  process  (in 
intuition,  low;  in  analysis,  high);  (d)  type  of  organizing  principle  (in 
intuition,  a  weighted  average;  in  analysis,  other,  task-specific  principles); 
(e)  type  of  error  (in  intuition,  normally  distributed;  in  analysis,  few,  but 
large  errors);  (f)  type  of  confidence  (in  intuition,  confidence  in  answer  but 
not  method;  in  analysis,  confidence  in  method,  not  answer).  (For  further 
distinctions,  see  Hammond,  1982.)  The  compromise  form  of  cognition,  quasi 
rationality  or  "common  sense,"  lies  in  between  these  polar  forms  of  cognition, 
and  thus  includes  properties  from  both  types  of  cognition.  Some  applications 
of  quasi  rationality  will  lie  closer  to  intuition,  some  closer  to  analysis. 
(See  Brunswik,  1956;  Hammond,  1955,  1966,  for  early  discussions  of 
"compromise"  and  quasi  rationality;  also  Hammond  1982,  for  a  comparison  of 
quasi  rationality  with  "bounded  rationality,"  introduced  by  Simon,  1957,  pp. 
196-206.;  see  Wyer,  1976,  for  an  example  of  compromise  among  probability 
estimates;  also  Payne,  '".976) 
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Descriptors  for  Task  Conditions  that  Induce  Different  Modes  of  Cognition 

In  his  1982  review,  Payne  indicates  that  research  shows  that  "decision 
making... is  highly  contingent  on  the  demands  of  the  task"  (p.  382).  Here  we 
provide  a  list  of  task  properties  predicted  to  induce  different  forms  of 
cognition.  If  subjects  are  not  provided  with  feedback,  the  task  properties 
that  differentially  induce  intuition  and  analysis  include:  (a)  number  of  cues 
available  (in  intuition,  large  [>  5];  in  analysis,  small):  (b)  the  order  in 
which  cues  are  displayed  (in  intuition,  simultaneous;  in  analysis, 
sequential);  (c)  the  type  of  cue  measurement  required  (in  intuition, 
perceptual;  in  analysis,  objective,  as  with  instruments)  and  the  reliability 

of  this  cue  measurement  (in  intui  ion,  low;  in  analysis,  high) ;  (d)  cue 

•  ! 

distribution  characteristics  (in  intuition,  continuous,  highly  variable, 

normally  distributed;  in  analysis  dichotomous,  valued  in  terms  of  specific 

I 

numbers,  distributions  unknown);  (e)  redundancy  among  cues  (in  intuition, 

i 

high;  in  analysis,  low);  (f)  the  degree  of  a  priori  decomposition  of  the 
task  for  the  subject  (in  intuition,  low;  in  analysis,  high);  (g)  the 
uncertainty  of  the  criterion  (in  intuition,  high;  in  analysis,  low);  (h)  the 

degree  of  nonlinearity  in  the  correct  environment  model  (in  Intuition,  low; 

'  | 

in  analysis,  high);  <i)  the  extent  to  which  the  cues  are  combined,  in  the 

correct  environmental  model,  with  equal  weights  (in  intuition,  high;  in 
analysis,  low);  and  (j)  the  availability  to  the  subject  of  an  organizing 
principle  (in  intuition,  low;  in  analysis,  high).  (See  Hammond,  1982,  for 
further  elaboration.)  In  her  research.  Golds  berry  (1983)  manipulated  (a) 
number  of  cues,  (b)  time,  (c)  availability  of  an  organizing  principle,  and  (d) 
complexity  of  the  principle  as  a  means  of  inducing  intuition  and  analysis. 
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Degrees  of  quasi  rationality  are  induced  to  the  extent  that  a  task 
contains  properties  from  both  pci.  r  task  conditions,  or  properties  whose 
values  lie  between  the  polar  values. 

Inducement  of  Cognitive  Properties 

A  specific  theoretical  prediction  is  that  each  set  of  task  properties 
will  induce  corresponding  cognitive  properties.  For  example,  if  the  task 
presents  (a)  many  redundant  cues  with  (b)  continuous  values  displayed  (c) 
simultaneously  that  must  be  measured  (d)  perceptually,  and  fcr  which  the 
subject  has  available  no  (e)  explicit  principle  or  method  f or  organizing  cues 
into  a  judcpnent,  then  the  subject  will  employ  intuitive  cognition.  That  is, 

I 

subjects  will  observe  and  use  many  redundant  cues  (because  of  their 

: 

simultaneous  display),  measure  their  values  perceptually  (because  there  is  no 

i 

alternative),  and  therefore,  subjective  cue  values  will  be  unreliably  assigned 

i  ... 

to  each  cue,  a  circumstance  reinforced  by  the  continuous  nature  of  the  cues, 

j 

thus  leading  to  inconsistency  or  low  cognitive  control.  Moreover,  if  the 

i 

subject  cannot  employ  the  appropriate  organizing  principle  either  because  s/he 

! 

knows  of  none,  or  time  will  not  permit  its  application,  then  a  weighted 

i 

averaging  method  of  organizing  the  information  will  be  implicitly  applied. 

| 

We  predict  that  a  weighted  averaging  or  simple  summation  organizing 
principle  will  be  used  because  these  are  the  most  robust  of  all  aggregation 
methods  (Dawes  t  Corrigan,  1974).  Robustness  means  high  accuracy  in  spite  of 
(a)  incorrect  assignment  of  weights,  (b)  poor  approximations  to  the  correct 
function  forms  between  cue  and  criterion,  and  (c)  poor  approximation  to  the 
correct  organizing  principle  in  the  task.  Such  robustness  would  provide  an 
epistemological  evolutionary  advantage  for  any  organism  capable  of  multiple 
cue  usage  in  tasks  that  induce  intuition,  particularly  when  time  is  limited. 
Therefore,  a  weighted  averaging  or  simple  summation  method  should  be  a  strong  , 
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candidate  for  an  intuitive  method  of  organizing  information  under  the 
intuition-inducing  conditions  described  above.  {See  Wallsten  &  Budescu,  1981, 
who  provide  empirical  support  for  a  similar  conceptual  link  between  additive 
processes  and  intuitive  (non-expert)  cognition;  see  Anderson,  1981,  for 
examples  of  studies  in  which  weighted  averages  frequently  appear  and  for  a 
detailed  technical  treatment  of  "cognitive  algebra";  see  Erunswik,  1956,  pp. 
89-99,  and  Hammond,  1980,  for  a  discussion  of  the  advantages  and  disadvantages 
of  intuitive  cognition  for  survival).  The  rationale  for  the  task  properties 
that  induce  analysis  is  opposite  in  substance  but  similar  in  form. 

The  verb  "induce"  is  used  to  avoid  the  implication  of  inevitability  or  a 
fully  deterministic  relation  between  task  properties  and  cognitive  properties. 
Zt  is  apparent  that  analysis  can  be  (and  is)  applied  to  intuition-inducing 
tasks  (e.g.,  if  there  is  time)  and  that  intuition  can  be  (and  is)  applied  to 
analysis-inducing  tasks  (e.g,  if  time  is  limited).  Moreover,  as  the  concept 
of  quasi  rationality  implies,  task  conditions  may  include  some  properties  from 
each  end  of  the  continuum  and  therefore  some  of  the  properties  of  each  polar 
mode  can  be  induced  in  a  single  task.  Thus,  tasks  with  properties  from  each 
pole  of  the  continuum  may  induce  a  compromise  between  intuition  and  analysis. 
(See  Brunswik,  1952,  1956;  see  also  Hammond,  1955,  1966,  and  Hammond  6 
Brehmer,  1973;  Brehmer,  1978,  demonstrates  the  role  of  task  properties  in  the 
production  of  compromise  in  interpersonal  conflict;  see  also  Tversky  £ 
Kahneman,  1983,  for  the  use  of  the  concept  of  cognitive  "trade-offs",  thus 


implying  compromise  between  one  mode  of  cognition  and  another.) 
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The  precise  location  of  cognitive  activity  on  the  cognitive  continuum 
will  depend  upon  (a)  how  many  and  (’■>)  which  task  properties  are  present,  as 
well  as  (c)  the  amount  of  a  property  present.  Unfortunately,  we  do  not  yet 
know  the  relative  power  of  various  task  properties,  however  specified,  to 
place  cognitive  activity  at  one  location  or  an  other  on  the  continuum.  Nor  is 
it  known  whether  one  task  property  is  essential  for  inducing  one  mode  or 
another,  or  how  effective  various  task  properties  are  in  moving  cognition  in 
one  direction  or  the  other.  The  study  to  be  described  below  takes  an  initial 
step  toward  the  acquisition  of  such  knowledge.  A  further  distinction  among 
task  conditions  needs  to  be  made,  however;  that  concerns  the  surface  and 
depth  characteristics  of  tasks . 

Differentiation  between  surface  and  depth  in  cognitive  tasks 

In  contrast  to  the  proliferation  of  concepts  that  are  employed  to 
describe  the  cognitive  activity  of  organisms,  the  texture  of  tasks  remains 
almost  wholly  undifferentiated,  despite  repeated  arguments  regarding  its 
importance  (see,  for  example.  Beach  6  Mitchell,  1978;  Einhorn  &  Hogarth, 

1991;  Payne,  1982).  But  Brunswik  (1957)  argued  that: 

Both  organism  and  environment  will  have  to  be  seen  as  systems,  each 
with  properties  of  its  own. ...Each  has  surface  and  depth,  or  overt  and 
covert  regions.  It  follows  that  much  as  psychology  must  be  concerned 
with  the  texture  of  the  organism. . .it  must  also  be  concerned  with  the 
texture  of  the  environment  (1957,  p.  5). 

Brunswik' s  distinction  between  surface  and  depth  has  been  developed  by 
Hammond,  Stewart,  Brehmer  and  Steinmann  (1975,  see  p.  275)  and  has  also  been 
employed  in  problem-solving  research  (Simon,  1979;  alro  see  Chi,  Glaser,  & 
Rees,  1982).  In  both  cases  the  term  "depth"  refers  to  the  (covert)  nature  of 
the  formal  relationships  of  the  variables  within  the  task,  while  "surface" 
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refers  to  the  (overt)  display  of  the  task  variables  to  the  subject.  (See  also 
Tversky  &  Xahneman,  1983,  who  use  the  terms  "opaque"  and  "transparent"  to 
refer  to  the  ease  with  which  different  forms  of  task  presentation  allow 
subjects  to  see  the  logical  character  of  the  tack.) 

Congruence  between  surface  and  depth  characteristics .  Since  both  depth 
and  surface  characteristics  can  be  located  on  the  task  continuum,  they  may 
therefore  be  congruent  or  incongruent  with  one  another,  depending  on  their 
respective  locations  on  the  task  continuum.  The  concept  of  congruence  may  be 
illustrated  as  follows.  A  logical  problem  will  by  definition  have  covert 
depth  properties  that  place  it  at  the  analysis-inducing  pole  of  the  continuum. 
But  the  overt  surface  materials  that  inform  the  subject  about  the  problem  may 
be  displayed  in  a  variety  of  ways,  some  of  which  may  also  be  analysis-inducing 
(and  thus  be  congruent  with  the  depth  characteristics  of  the  task)  while  some 
■ay  be  intuition-inducing  (and  thus  be  incongruent  with  them).  Thus,  for 
example,  the  surface  displays  for  a  logical  problem  may  be  presented  (in 
decreasingly  congruent  fashion)  by  (a)  symbolic  logic,  (b)  the  languages  for 
computer  programs  (c)  natural  languages,  (d)  diagrams,  or  (e)  pictures.  At 
the  other  extreme,  surface  displays  for  tasks  in  which  depth  characteristics 
are  intuition-inducing  may  also  vary  along  the  intuition-analysis  continuum. 
The  overt  surface  materials  for  pictorial  work  of  art  may  (in  decreasingly 
congruent  fashion)  be  (a)  displayed  visually,  (b)  diagrammed  to  show  its  form 
(as  da  Vinci's  "Last  Supper"  has  been  diagramed ) ,  (c)  described  in  natural 
language,  or  (d)  in  the  language  of  a  computer  program  (in  the  case  of 


computer-produced  a. c ) 
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Various  combinations  of  intuition*  and  analysis-inducing  surface 
characteristics  are  often  used  in  both  types  of  tasks,  thus  rendering  them 
quasi-rational  i».  character.  For  example,  art  teachers  induce  quasi-rational 
cognition  when  they  point  to  various  visual  features  of  a  work  of  rrt,  ask 
students  to  appreciate  them  by  use  of  visual  perception,  and  then 
systematically  verbally  analyze  the  features  that  justify  its  classical 
status.  An  opposite  example  is  provided  by  the  physics  teacher  who  displays  a 
set  of  relations  first  in  the  form  of  an  equation,  and  then  in  the  form  of  a 
pictorial,  schematic  model.  In  this  case  the  schematic  model  is  employed  to 
appeal,  via  visual  perception,  to  intuitive  cognition,  thus  inducing  students 
to  increase  their  confidence  that  the  abstract  equation  is  true.  (Miller, 
1978,  describes  disputes  among  early  quantum  theorists  about  whether  visual, 
ana  thus  intuitively  appealing,  representations  of  the  relations  among 
concepts  should  be  allowed  to  supplement  mathematical,  and  thus  fully 
analytical,  representations.) 


Despite  the  long-apparent  differentiation  between  the  surface  and  depth 
characteristics  of  tasks,  no  systematic  treatment  of  the  effect  of  their 
relation  has  yet  appears * .  although  it  is  an  intrinsic,  inescapable  component 
of  every  cognitive  task.  Payne  (1982,  pp.  392-392),  for  example,  describes 
the  importance  of  "information  display”  and  describes  its  effects,  but  none  of 
the  studies  he  review/  systematically  examines  various  purface  displays  across 
different  depth  characteristics  of  tasks,  thus  leaving  indeterminate  the 
question  of  which  aspect  of  che  task  has  greater  influence  on  decision 
behavior.  (But  see  Aaelmar,  1981,  and  Brehmer  &  Kuylenstierna ,  1980,  for  an 
examination  of  the  effects  of  the  congruence  between  task  content  and  formal 
relations  in  tasks;  and  Pennington,  1982,  for  a  demonstration  of  the  role  of 
congruence  of  task  elements  in  relation  to  subjects'  use  of  the 
representativeness  heuristic;  see  also  Hammond,  1966,  for  a  distinction 
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between  the  formal  and  substantive  properties  of  tasks . ) 


In  the  present  study,  we  systematically  vary  the  degree  of  congruence 
between  surface  and  depth  characteristics  of  tasks  in  terms  of  their  locus  on 
the  task  continuum.  That  is,  we  employ  three  tasks  whose  depth 
characteristics  enable  us  to  place  (a)  one  at  the  intuition-inducing  pole,  (b) 
one  at  the  analysis-inducing  pole,  and  (c)  one  in  between.  We  also  employ 
three  different  sets  of  surface  characteristics,  or  displays,  for  each  of  the 
three  tasks  (see  Figure  1).  The  surface  characteristics  aiso  were  constructed 
so  that  one  display  included  properties  that  placed  it  near  the 
intuition-inducing  pole,  one  display  represented  the  properties  of  the 
analysis-inducing  pole,  and  one  represented  conditions  between.  Since  we  wish 
to  make  direct  comparisons  of  the  effect  of  surface-depth  congruence  on  the 
cognitive  activity  of  the  same  subject  over  these  task  conditions,  each 
subject  was  tested  in  all  nine  cells  of  Figure  1. 


Insert  Figure  1  about  here 


Effects  of  Surface-Depth  Congruence  on  Inducement  of  Cognitive  Activity 


On  the  hypothesis  that  the  effects  of  surface  and  depth  characteristics 
are~additive,  inducement  of  any  mode  of  cognition  should  be  most  predictable 
when  surface  and  depth  task  characteristics  are  congruent,  and  least 
predictable  when  they  are  incongruent.  Specifically,  if  both  surface  and 
depth  characteristics  are  intuition-inducing,  then  all  the  properties  of 
intuitive  cognition  should  be  induced.  The  same  holds  for  quasi  rationality 
and  analysis.  When  there  is  incongruence  between  surface  and  depth, 
compromise  among  cognitive  properties  should  occur  and  cognitive  activity 


should  be  located  in  between. 


/ 
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Effects  of  Surface-Depth  Congruence  and  cf  Mode-Task  Correspondence  on 
Achievement 

Achievement  should  be  highest  when  surface  task  properties  and  depth  task 
properties  are  congruent  and  when  cognitive  mode  corresponds  to  task.  Th®se 
hypotheses  are  in  direct  contradiction  to  the  view  generally  accepted  by 
researchers  that  analytical  cognition  is  superior  to  intuitive  cognition  over 
all  task  conditions.  It  can  be  argued,  however,  that  when  the  task  conditions 
are  those  described  above  as  intuition-inducing,  attempts  to  use  analysis  run 
the  risk  of  incurring  both  substantive  and  procedural  failures,  and  thus 
intuition  may  outperform  analysis.  (For  a  parallel  view  by  a  philosopher,  see 
Rosen,  1980.) 

The  theoretical  background  presented  above  thus  provides  general 
hypotheses  (to  be  made  specific  below)  regarding  task  properties,  cognitive 
properties  and  their  joint  effects  on  behavior  in  a  study  of  expert  judgment. 
In  addition,  the  work  carried  out  to  test  these  hypotheses  will  clarify  (a) 
whether,  in  direct  comparisons  between  analytical  cognition  and  intuitive 
cognition,  analysis  provides  a  ceiling  for  performance,  and  (b)  the  role  of 
error  in  analytical  cognition. 

Method 

Subjects 

Twenty-one  expert  highway  engineers  (male,  30-70  years  of  age)  were 
chosen  as  subjects  because  of  their  trained  capacity  to  engage  in  analytical 
cognition,  as  well  as  the  other  two  modes  of  cognition.  Each  of  the  21 
experts  volunteered  approximately  20  hours  to  the  project. 
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Depth  Characteristics  of  Tasks 

Three  tasks  were  selected  because  we  judged  that  their  characteristics 
would  induce  each  of  the  three  modes  of  cognition.  These  tasks  required 
predictions  of  (a)  highway  aesthetics  (intuition-inducing),  (b)  highway  >afety 
(quasi  rationality-inducing),  and  (c)  highway  capacity  (analysis-inducing). 
Each  is  described  in  turn;  objective  measures  are  described  below. 

Intuition.  Judgments  of  aesthetics  were  used  because  .^e  depth 
properties  of  this  task  include  many  of  the  intuition-inducing  properties 
indicated  above.  For  example,  there  is  no  known  algorithm  for  organizing 
aesthetic  cues,  and  no  delimited  specification  of  which  cues  are  relevant; 
indeed,  there  is  no  indication  of  how  aesthetics-related  information  (wnatever 
it  may  be)  should  be  used.  Consequently,  judgments  of  highway  aesthetics 
depend  largely  on  the  use  of  perceptual  material  provided  by  the  visual 
inspection  of  a  highway  and  are  never  arrived  at  by  calculation.  The 
intuition-inducing  properties  of  this  task  are  illustrated  in  the 
(tape-recorded)  remarks  of  the  engineers;  for  example,  one  engineer  stated; 
"My  confidence  will  be  zero.  When  you  get  done  and  ask  me  how  I  did  this  I 
will  say,  'I  don't  know.'" 

Quasi  rationality.  Judgments  of  safety  were  used  as  a  quasi  _ 

rationality-inducing  task.  The  depth  properties  of  this  task  include  some 
intuition-inducing  properties  and  some  analysis-inducing  properties,  and  some 
properties  that  are  midway  betwe  n  the  two,  thus  placing  this  task  between  the 
polar  cognitive  modes.  Although  there  is  no  established  theory,  algorithm,  or 

a 

equation  for  calculating  the  safety  of  a  highway,  and  there  is  no  clearly 
delimited  set  of  cues  that  are  officially  or  professionally  designated  for 
measuring  or  judging  the  safety  of  highways  (thus  allowing  for  some  degree  of 
intuition  as  described  above),  nevertheless  there  is  general  agreement  about 
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what  dimensions  or  cues  (e.g.,  lane  w.'dth}  should  be  used,  and  what  their 
functional  relationships  with  safety  are.  And  more  or  less  defensible 
explanations  can  be  provided  for  why  certain  dimensions  should  be  used  in  the 
form  given,  thus  indicating  that  some  degree  of  analysis  occurs.  For  example, 
one  engineer  stated:  "I  will  . . .  select  the  most  important  points  that  have  a 
tendency  to  constitute  accidents  ....  probably  the  most  important  would  be  the 
curves  per  mile  ....  shoulder  width  is  the  next  most  important  thing" . 

Analysis .  Judgments  of  highway  capacity  were  used  as  an 
analysis-inducing  task  because  its  depth  properties  include  many  of  the 
analysis-inducing  properties  indicated  above.  That  is,  it  is  generally  agreed 
that  the  capacity  of  a  highway  can  be  calculated  using  a  non-stochastic, 
non-linear  algorithm  based  on  well  known  dimensions.  The  relations  between 
these  dimensions  and  capacity  are  well  known  to  highway  engineers,  the  process 
is  analytically  and  technically  defensible,  and  it  is  in  regular  use  in  the 
design  of  highways.  Thus,  for  example,  one  engineer  said:  "The  idea  of 
taking  a  maximum  capacity  . . .  and  then  multiplying  it  by  factor?  is  the 
Highway  Capacity  Manual  way  of  doing  it.  And  so  I  knew  it  was  a  legal  way  to 
go  about  it,  but  I  didn't  remember  the  process  exactly,  or  the  numbers 
especially." 

Surface  Characteristics  of  TaskB 

Three  forms  of  displaying  information  were  constructed,  in  accordance 
with  cognitive  continuum  theory,  to  induce  three  modes  of  cognition  within 
each  task.  Each  is  described  in  turn;  objective  measures  are  described 


below 
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Intuition.  The  engineers  were  induced  to  employ  intuitive  cognition  for 
each  task  (aesthetics,  safety  and  capacity)  by  being  required  to  judge  forty 
two-lane  rural  Colorado  highways  from  film  strips  representing  one-  to 
three-mile  segments  of  these  highways  (see  Figure  2).  The  film  strip 
presentation  is  intuition-inducing  because  all  the  information  must  be 
processed  by  visual  perception.  Moreover,  the  cues  displayed  in  the  film 
strips  are  numerous,  frequently  redundant,  and  contemporaneously  displayed; 
the  values  of  the  cues  are  generally  continuous  and  normally  distributed,  a~d 
the  cue  values  must  be  measured  solely  by  visual  examination.  Furthermore,  no 
time  was  provided  to  organize  the  information  according  to  an  analytical 
principle. 


Insert  Figure  2  About  Here 


Quasi  rationality.  The  engineers  were  induced  to  employ  quasi-rational 
cognition  for  each  task  by  being  required  to  judge  bar  graphs  representing  the 
same  highway  segments  as  in  the  film  strips  ( see  Figure  3 ) .  The  bar  graphs 
induce  both  intuition  and  analysis.  They  induce  intuition  because  the  cues 
are  displayed  visually  and  contemporaneously;  the  cues  are  redundant  and  are 
generally  continuous  and  normally  distributed.  The  bar-graph  presentation 
also  induces  analysis,  however,  because  the  number  of  cues  is  reduced  from  a 
large,  unknown  number  to  a  specific  set  (aesthetics  -  8,  safety  >10, 
capacity  >9),  each  cue  is  visually  separated  from  the  others  and  it-, 
numerical  value  is  clearly  indicated;  and  cue  values  are  not  measured 
perceptually,  rather,  they  are  measured  by  instrument  and  numerically 
presented,  thus  facilitating  brief  comparison. 


Second  Direct  Comparison 
Hammond,  Hamm,  Grassia  and  Pearson 


Insert  Figure  3  About  Here 


Analysis.  The  engineers  were  given  the  names  of  the  same  variables  that 
were  provided  in  the  bar  graph  presentation  for  each  task.  They  were  induced 
to  employ  analytical  cognition  by  teii.g  required  to  devise  mathematical 
formulas  frr  calculating  aesthetics,  safety  and  capacity  for  all  two-lane 
rural  highways.  The  engineers  were  cold  that  although  a  certain  amount  of 
time  had  been  targeted  for  this  task,  they  could  work  until  their  formulas 
were  completed.  They  were  provided  with  paper,  pencils,  and  a  calculator. 

Twelve  engineers  were  required  to  construct  their  formulas  without 
interference  from  the  researchers  ("minimal  guidance").  Another  six  experts 
were  required  to  "think  aloud"  as  they  constructed  their  formulas,  and  their 
responses  were  recorded  on  tape.  The  remaining  three  experts  were  given 
extensive,  systematic  guidance  ("maximal  guidance")  in  constructing  their 
formulas  that  emphasized  the  use  of  analytical  cognition  (see  Apper dix  A). 
These  variations  in  the  analysis-inducing  conditions  were  implemented  to 
encourage  analysis  and  to  obtain  information  about  the  engineers'  analytical 
efforts,  not  to  determine  their  differential  effects  on  cognition.  (They  did 
not,  in  fact,  result  in  significant  differences  in  cognitive  mode  or  in 
achievement  among  the  engineers.)  See  Figure  4  for  an  illustration  of 
mathematical  formulas  for  aesthetics,  safety,  and  capacity. 
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Insert  Figure  4  about  here 
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Independent  Variables 

The  features  that  cause  the  depth  and  surface  task  conditions  to  differ 
in  their  propensity  to  induce  intuitive  or  analytical  cognition,  as  just 
described,  can  be  measured  with  a  task  continuum  index. 

Task  continuum  index .  Eight  of  the  task  characteristics  predicted  by 

cognitive  continuum  theory  to  induce  different  modes  of  cognition  were  used  to 

construct  a  Task  Continuum  Index  (TCI)  The  TCI  includes  measures  of  (a)  the 

number  of  cues  presented,  (b)  the  redundancy  among  the  cues  (the  mean 

intercorrelation ) ,  (c)  the  reliability  of  cue  measurement  (assigned  a  value  of 

1  in  the  bar  graph  and  formula  conditions,  and  estimated  by  the  mean 

intercorrelation  among  the  cue  judgments  of  several  experts  for  the  film-strip 

condition),  (d)  the  degree  to  which  the  task  is  decomposed  for  the  subject, 

(e)  the  availability  of  an  organizing  principle  to  the  subject,  (f)  the  degree 

of  nonlinearity  in  the  optimal  organizing  principle  (see  explanation  of  second 

subindex  of  CCI,  below),  (g)  the  extent  to  which  the  cues  are  weighted  equally 

in  the  optimal  organizing  principle  for  the  task  (standard  deviation  of  the 

2 

Beta  weights),  and  (h)  the  degree  of  certainty  in  the  criterion  (P.  of 
environment  model).  Scores  on  the  eight  measures  were  aggregated  by  adding 
them.  In  the  absence  of  any  information  about  the  relative  power  of  task 
properties  to  induce  cognitive  properties,  or  the  possible  interactions 
between  them,  the  additive  function  was  chosen  because  it  is  the  simplest  and 
most  robust  under  the  circumstances. 


O 


/ 
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The  TCI  thus  provides  a  measure  that  permits  each  of  the  three  tasks  to 
be  located  on  the  task  continuum  for  both  surface  and  depth  conditions.  The 
TCI  values  for  the  nine  conditions  are  shown  in  Table  1.  The  row  and  column 
means  of  Table  1  indicate  that  although  equal  distances  were  not  established 
among  the  conditions  employed,  the  appropriate  order  was  achieved. 

Insert  Table  1  about  here 


Dependent  Variables 

The  effects  of  the  independent  variables  described  above  were  examined 
with  respect  to  (a)  the  location  of  each  subjects'  cognitive  activity  on  the 
cognitive  continuum,  (b)  each  engineer's  degree  of  empirical  achievement  in 
predicting  each  criterion  accurately  in  the  nine  conditions. 

Cognitive  continuum  index .  Four  of  the  characteristics  of  cognition 
(predicted  by  cognitive  continuum  theory  to  discriminate  between  intuitive  and 
analytical  cognition)  were  available  in  the  present  study  and  thus  used  to 
construct  a  cognitive  continuum  index  (CCI).  The  four  were  measures  of  (a) 
cognitive  control,  (b)  organizing  principle,  (c)  error  distribution,  and  (d) 
differential  confidence. 

Cognitive  control  is  measured  by  Rs,  the  linear  predictability  of  the 
engineer's  judgments  in  the  film  strip  and  bar  graph  conditions.  This  was 
deemed  an  acceptable  approximation  to  cognitive  control  due  to  the  low 
nonlinear  use  of  cues  that  was  observed  in  the  data.  In  the  formula 
condition,  cognitive  control  was 'measured  by  the  correlation  between  the 
answers  produced  by  the  formula  the  engineer  intended  to  present  to  the 


research  team  and  the  formula  he  actually  presented  (see  Appendix  B) 


% 
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The  extent  to  which  the  engineer's  judgnents  are  produced  by  a  nonlinear 

organizing  principle  is  a  second  subindex  of  the  CCI.  This  is  measured  by  the 

2 

difference  between  the  R  of  a  nonlinear  model  of  the  judgments  (whose 

predictors  include  squared  cue  measures  and  selected  interaction  terms)  and 
2 

the  R  of  the  linear  model. 

Error  distribution  is  measured  by  the  kurtosis  of  the  distribution  of 
errors,  that  is,  differences  between  the  engineer's  judgments  and  the 
criterion,  after  the  judgments  have  been  rescaled  onto  the  same  range  as  the 
criterion.  A  positive  kurtosis  denotes  the  peaked  distributions  expected  to 
occur  with  analysis,  where  the  answers  are  usually  very  accurate  yet 
occasionally  highly  inaccurate. 

The  final  measure  included  in  the  CCZ  is  the  difference  between  the 
engineer's  confidence  in  his  method  and  his  confidence  in  his  answers.  Since 
method  confidence  is  expected  to  be  high  in  analysis,  and  answer  confidence  to 
be  high  in  intuition,  the  greater  the  difference  between  these  measures  the 
more  analytic  the  cognitive  activity  was  expected  to  be. 

The  CCI  was  calculated  so  that  if  in  any  task  condition  an  engineer 
exhibited  (a)  high  cognitive  control,  (b)  a  highly  nonlinear  organizing 
principle,  (c)  higher  kurtosis  (more  peaked,  higher  tails)  in  his  error 
distribution  (thus  indicating  a  greater  number  of  nearly  correct  answers  and  a 
larger  number  of  large  errors),  and  (d)  greater  difference  between  method  and 
answer  confidence,  then  he  would  receive  a  high  analytical  score  on  the  CCI. 

If  the  reverse  conditions  held,  the  subject  would  receive  a  low  analytical 
(and  thus  high  intuitive)  score  on  the  CCI.  Each  raw  measure  was  rescaled 
within  each  engineer  to  a  common  scale  and  the  sub**scores  were  combined  by  a 
simple  additive  (equal  weights)  procedure.  Therefore  each  score  was  relative 
to  each  engineer's  own  performance,  not  to  an  absolute  score. 
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Note  that  both  the  CCI  and  the  TCI  are  compensatory;  a  low  score  on  one 
sub-index  may  be  compensated  for  by  a  high  score  on  another  sub-index.  This 
form  was  chosen  because  it  represents  the  intersubstitutability  of  cognitive 
activities,  an  essential  part  of  the  general  theory  of  probabilistic 
functionalism  put  forward  by  Brunswik  (1952,  1956)  and  Hammond  (1966,  1982). 

Achievement.  The  correlation  (r  )  between  an  engineer's  iudqments  over 

1  gl 

the  set  of  highways  and  the  appropriate  criterion  (described  below)  were 
measured  in  each  task  in  each  display  mode,  using  the  methods  described  in 
Appendix  B. 

Knowledge  is  measured  in  the  intuitive  and  guasi-rational  surface 
conditions  by  G  (from  the  lens  model  equation;  see  Appendix  B).  In  the 
analytical  mode,  the  correlation  between  the  criterion  and  the  answers 
produced  by  the  engineer's  intended  formula  serves  as  a  measure  of  knowledge, 
i.e.,  of  what  the  engineer  could  have  achieved  if  he  had  executed  his 
knowledge  with  perfect  cognitive  control.  The  distinction  between  the  degree 
of  accuracy  achieved  with  the  Intended  formula  and  with  the  formula  actually 
used  is  essential  in  any  effort  to  compare  the  use  of  analytical  cognition 
with  the  use  of  intuition.  (See  Hammond  et  al.,  1975,  for  a  detailed 
discussion  of  the  distinction  between  consistency  and  oognitive  control ;  see 
also  the  literature  on  the  discrepency  between  "mental  models"  and  task 
properties  in  Simon,  1979.) 
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Procedure 


Task  Materials 


The  same  set  of  forty  highway  segments  was  used  in  all  nine  cells  of  the 


study. 


Statistical  properties  of  the  intuition-inducing  (aesthetics  juc 


task.  The  aesthetics  criterion  was  produced  by  a  group  of  91  citizens  who 
judged  the  40  highways.  In  order  to  vary  methods,  some  of  the  citizens  viewed 
the  film  strips,  some  viewed  slides,  and  some  viewed  photo-copies  of  one  or 
four  frames  from  the  film  strip.  The  slides  and  film  strips  were  rated,  and 
the  photo-copies  were  rated  or  rank-ordered.  The  91  citizens'  judgments  were 
factor  analyzed.  Only  one  factor  was  identified;  there  was  no  evidence  of: 
method  factors.  The  score  for  each  highway  on  this  factor  served  as  the 
criterion  measure  of  its  aesthetic  value. 


Eight  aesthetics  cues  were  presented  to  the  engineers  in  the  bar  graph 
and  formula  tasks.  The  cue  values  were  determined  by  averaged  ratings  of  the 
cue  values  from  14  of  the  citizens,  who  rated  the  cues  for  each  of  the  40 
highways  upon  viewing  the  film  strips. 


A  linear  model  of  the  task  yielded  an  R  of  .937  (corrected  for 

1 

estimated  shrinkage,  .920).  The  correlation  between  each  cue  end  the 
criterion,  as  well  as  the  intercorrelations  among  the  cues,  is  given  in  Table 


2.  The  average  intercorrelation  among  cues  is  .56. 
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Insert  Table  2  about  here 


Statistical  properties  of  the  quasi  rationality-inducing  ( safety 
judgment?  task.  The  criterion  for  the  accuracy  of  judgments  is  the  accident 
rate,  averaged  over  seven  years,  for  each  of  the  40  highways.  Accident  rate 
is  defined  as  the  total  number  of  accidents  (involving  fatalities,  injuries, 
or  only  property  damage)  divided  by  the  number  of  vehicle  miles  traveled. 

(One  highway  with  an  extremely  high  accident  rate  was  considered  to  be  an 
unrepresentative  outlier  and  was  not  used  in  the  analysis  of  safety 
judgments. ) 

Highways  were  measured  on  ten  dimensions,  chosen  for  inclusion  in  the 
study  on  the  basis  of  discussions  with  highway  safety  experts  who  indicated 
the  information  they  considered  essential  for  evaluating  the  safety  of  a  road 
(see  Table  3  for  list).  Eight  of  these  measures  were  available  from  highway 
department  records;  two  measures  (number  of  curves  per  mile  and  number  of 
obstacles  per  mile)  had  to  be  counted  by  the  experimenters  from  visual 
inspection  of  film  strips  of  each  highway  segment.  The  beta  weights  for  each 
dimension  or  cue  in  predicting  accident  rate  are  also  presented  in  Table  3. 
Visual  examination  of  the  scatter-plots  of  the  relations  between  each  cue  and 
the  criterion  indicated  little  if  any  nonlinear  co-variation.  This  finding 
was  supported  by  the  results  from  calculation  of  the  contribution  of  squared 
terms  and  interactions  to  accident  rates,  which  is  negligable. 
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Insert  Table  3  About  Here 


An  optimally  weighted  linear  multiple  regression  model  of  the  task 
indicates  that  «  .363;  corrected  for  estimated  shrinkage,  Re  ”  .809. 
Application  of  equal  weights  and  linear  functions,  each  cue  given  the  sign 
that  appeared  in  the  best  fit  equation,  yields  an  of  .769  (corrected  for 
shrinkage  R^  -  .667).  The  intercorrelations  among  the  ten  cues  and  the 
criterion  are  presented  in  Table  3. 

Statistical  properties  of  the  analysi s-inducing  ( capacity  judgment)  task. 
The  criterion  for  the  accuracy  of  judgments  of  capacity  is  the  maximum  number 
of  vehicles  that  the  road  could  carry  in  both  directions  in  one  hour  under 
ideal  conditions.  Each  highway's  capacity  was  determined  by  applying  a 
standard  procedure  from  the  Highway  Capacity  Manual  (Highway  Research  Board, 
1965)  to  the  measured  features  of  the  highway  (see  Appendix  C). 

The  highways  were  measured  on  nine  dimensions,  each  of  which  was  chosen 
for  inclusion  either  because  it  was  involved  in  the  formal  procedure  that 
highway  departments  typically  use  for  determining  capacity  or  because  it  was 
plausibly  related  to  capacity  (see  Table  4  for  list).  These  measures  were 
available  from  the  Colorado  Department  of  Highways  records. 

Insert  Table  4  About  Here 


Because  the  capacity  criterion  is  a  fully  determined  function  of  the  set 
of  highway  dimensions,  the  procedure  also  serves  as  the  model  of  the 
environment.  Thus,  there  is  no  environmental  error,  and  the  model  of  the 
environment  is  neither  linear  nor  additive.  The  formulas  in  Appendix  B  show 
the  approximate  degree  of  nonlinearity  in  the  model.  Additionally,  the 


/ 
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function  forms  have  steplike  discontinuities  rather  than  being  linear  or 
smooth  because  the  procedure  involves  tables.  The  model  of  the  subject,  on 
the  other  hand,  is  estimated  by  linear  regression.  And  since  the  models  of 
environment  and  subject  are  of  different  kinds,  the  generalization  of  the  Lens 
Model  Equation  described  by  Stewart  (1970)  was  used  for  this  situation  (see 
Appendix  B  for  further  detail ) . 


Scales 


Rating  scales  were  constructed  to  be  appropriate  to  the  cognitive 
activity  induced.  Thus,  an  abstract  rating  scale  from  1  (low)  to  10  (high) 
was  used  for  judging  aesthetics,  safety,  or  capacity  from  the  film  strips,  to 
induce  intuitive  cognition.  Zn  the  bar-graph  presentation  and  in  the  task 
requiring  the  construction  of  a  formula,  scales  specific  to  the  task  were  used 
because  this  specificity  is  compatible  with  calculation  and  thus  with 
analytical  cognition.  Thus  in  the  capacity  judgment  task  a  scale  from  750  to 
2500  vehicles  per  hour  was  employed,  and  in  the  safety  judgment  task  a  scale 
from  0  to  32  accidents  per  million  vehicles  miles  traveled  was  employed.  The 
1  to  10  acale  was  used  in  all  three  surface  task  conditions  for  the  aesthetics 
judgnent  task.  Transformations  to  a  common  scale  were  made  for  purposes  of 
data  analysis. 


Order  of  Presentation 

All  engineers  were  presented  with  the  surface  task  conditions  in  the  same 
order:  first,  the  film  strips;  second,  the  bar  graphs;  third,  the  materials 
for  formula  construction.  Surface  conditions  were  deliberately  not 
counterbalanced  because  it  has  already  been  demonstrated  that  analytical  work 
requiring  use  of  certain  cues  in  an  explicit  fashion  influences  subsequent 
intuitive  judcpnents,  whereas  the  reverse  is  not  true  (Jones  &  Harris,  1982). 
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The  order  of  depth  conditions  within  each  surface  condition  was 
counterbalanced  across  all  engineers.  Participation  in  each  surface  condition 
was  separated  by  at  least  a  week. 

In  the  intuition-inducing  surface  condition,  ten  of  the  forty  highways 
were  shown  twice;  in  the  quasi  rationality  inducing  surface  condition  sixteen 
highways  were  shown  twice.  These  repetitions  permitted  calculation  of 
repeated  trials  reliability  for  each  engineer.  These  data  were  not  used  for 
comparison,  however,  because  the  values  for  the  intuition-inducing  conditions 
were  inflated  due  to  recognition  of  the  highways  in  the  film  strips. 

Time 

Response  times  in  the  nine  conditions  were  determined  by  surface  task 
conditions  ar.l  thus  are  not  dependent  variables;  that  is.  presentation  of  a 
film  strip  necessarily  required  more  of  a  subject's  time  than  presentation  of 
a  bar  graph.  The  moan  response  time  In  the  film-strip  condition  (where  the 
engineer  saw  approximately  100  separate  exposures  for  each  of  40  highway 
segments)  was  64  seconds,  and  in  the  bar-graph  condition  (where  the  engineer 
was  shown  one  bar  graph  for  each  highway  segment),  it  was  19  seconds. 

In  the  formula-p  roducing  condition  the  response  time  varied  within  the 
three  subgroups.  The  18  eng;*  jeers  in  the  "think  aloud”  and  "minimal  guidance” 
subgroups  were  encouraged  to  complete  their  formulas  within  forty-five 
minutes;  but  their  mean  time  over  all  three  tasks  was  51  minutes.  No  time 
constraints  were  imposed  on  the  engineers  in  the  "maximal  guidance"  condition; 
mean  response  time  over  all  three  tasks  was  2  hours  and  40  minutes. 
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Hypotheses  and  Results 

Two  methods  were  used  for  analyzing  the  data;  correlational  analysis  and 
order  table  analysis. 

The  correlational  analysis  examines  the  covariation  between  the  TCI  (task 
properties  combined  into  an  index  of  task  location)  and  the  CCI  (cognitive 
properties  combined  into  an  index  of  cognitive  location).  Correlations 
computed  for  each  engineer  over  the  nine  conditions  indicate  the  extent  to 
which  (a)  task  location  induces  cognition  to  be  activated  at  the  predicted 
location,  (b)  task  location  is  related  to  achievement,  and  (c)  the  absolute 
difference  between  the  induced  location  of  the  engineer's  cognitive  activity 
(CCI)  and  the  location  of  the  task  (TCI)  is  related  to  achievement. 

The  order  table  analysis  allows  us  to  ascertain  whether  task  properties 
induce  the  predicted  mode  of  cognition  for  each  engineer  for  each  of  the 
surface  and  depth  task  conditions  separately.  The  relation  between  the 
predicted  and  the  observed  order  of  location  on  the  cognitive  continuum  among 
the  three  cells  of  a  particular  row  (depth  task  condition)  or  column  (surface 
task  condition)  of  the  study  design  (Figure  1)  is  examined  by  counting  how 
many  engineers  had  the  expected  order  of  location,  measured  in  terms  of  the 
CCI.  This  method  allows  hypotheses  to  be  tested  by  determining  whether  the 
number  of  engineers  with  the  expected  orders  exceeds  chance.  A  similar 
analysis  is  applied  to  the  question  of  whether  the  correspondence  of  task 
location  and  cognitive  location  on  their  respective  continua  determine  the 
degree  of  achievement  in  the  nine  task  conditions  examined. 
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The  order  table  analysis  thus  provides  a  highly  detailed  description  of 
each  engineer's  performance;  it  indicates  why  the  correlations  between  TCI 
and  CCI  were  as  high  or  low  as  they  were  found  to  be. 

Inducement 

The  inducement  analyses  are  concerned  with  the  extent  to  which  the 
position  of  the  task  on  the  TCI  induces  cognition  to  be  activated  at  a 
corresponding  position  on  the  CCI. 

Correlational  Analysis 

HI:  Task  properties  induce  corresponding  cognitive  properties. 

The  Cognitive  Continuum  Index  (CCI)  was  correlated  with  the  Task 
Continuum  Index  (TCI)  over  the  nine  conditions  for  each  engineer.  These 
correlations  were  positive  for  19  of  the  21  engineers.  Nine  of  the  positive 
relations  were  significant  at  the  p  <  .05  (df  -  7,  one-tailed)  level.  The 
mean  correlation  (after  appropriate  z-transformations)  is  .506  which  is 
significantly  different  from  zero  (t  *  6.63,  p  <  .001,  df  »•  20). 

In  addition,  the  CCI  for  each  engineer  was  separately  correlated  with 
measures  of  depth  task  characteristics  and  surface  task  characteristics  (the 
average  value  of  each  row  and  column  in  Table  1,  respectively).  The 
correlation  between  CCI  and  the  surface  TCI  was  positive  for  18  engineers,  and 
6  of  these  relations  were  significant  at  p  <  .05  (df  =  7,  one-tailed).  The 
mean  correlation  (appropriately  z-trans formed)  was  .384  (t  *  3.89,  p  <  .001, 
df  ■  20,  one-tailed).  Similarly,  the  correlation  between  CCI  and  the  depth 
TCI  was  positive  for  20  engineers  (5  significant),  and  the  mean  correlation 


was  .391  (t  -  5.36,  p  <  .001). 


Second  Direct  Comparison  .  Page  31 

Hammond,  Hamm,  Grassia  and  Pearson  31  May  84 

degression  of  CCI  onto  surface  and  depth  TCI  provides  evidence  that 
surface  task  characteristics  are  more  powerful  than  depth  characteristics  in 
inducing  cognitive  mode.  Since  the  surface  and  depth  TCI  indices  £ re  derived 
frcm  the  same  measure,  their  regression  coefficients  may  be  meaningfully 
compared.  The  mean  b-coef f icient  for  the  surface  TCI  index  was  .599 

» 

(t  =  4.57,  p  <  .001,  df  =  20,  one-tailed),  and  the  mean  depth  TCI 
b-ccefficient  was  .244  (t  =  6.60,  p  <  .001).  The  different  size  of  the 
regression  coefficients  reflects  the  fact  that  although  there  was  less  range 

» 

of  variation  on  the  TCI  due  to  the  surface  conditions  than  to  the  depth 
conditions,  nevertheless  surface  conditions  were  found  to  have  as  large  an 
effect  as  depth  conditions. 

In  sum,  the  results  of  the  correlational  analysis  indicate  that  (a)  teak 
properties  induce  cognitive  activity  to  assume  corresponding  properties,  and 

1  (b)  surface  task  conditions  have  a  greater  effect  on  inducement  than  depth 

task  conditions. 


H2:  When  surface  and  depth  task  characteristics  are  congruent 

(i.e.,  occupy  the  same  location  on  the  task  continuum),  task 
characteristics  will  be  most  effective  at  inducing  the 
corresponding  mode.  _ 

When  surface  and  depth  task  characteristics  are  congruent  they  should  be  most 
effective  in  inducing  the  corresponding  mode  of  cognition-  Hence,  surface  and 
depth  task  conditions  should  combine  additively  in  inducing  cognitive  mode. 
Non-additive  combination  (e.g.,  conjunctive  or  disjunctive  combination)  would 
indicate  that  the  additive  model  is  not  the  best  descriptor  of  how  surface  and 
depth  task  conditions  combine  in  inducing  location  on  the  cognitive  mode.  For 
example,  a  conjunctive  model  would  apply  if  analysis-inducing  levels  on  all 
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task  features  (both  surface  and  depth)  are  necessary  to  induce  analytic 
cognition.  On  the  other  hand,  a  disjunctive  model  would  apply  if  an 
analysis-inducing  level  on  any  task  feature  (either  surface  or  depth)  were 
sufficient  to  induce  analytic  cognition.  To  test  these  possibilities, 
conjunctive  and  disjunctive  models  as  proposed  by  Einhom  ( 1971 )  were 

constructed  for  predicting  CC1  from  depth  and  surface  TCZ,  and  their 

2 

explanatory  power  (R  )  was  compared  with  that  of  the  simple  linear  additive 
2 

model.  The  mean  R  's  across  the  21  engineers  ( arcsine  transformed)  were: 
linear,  .456;  conjunctive,  .471;  disjunctive,  .470.  The  differences  are 
negligable.  Since  the  nonadditive  competing  models  offer  no  significant 
advantage  over  the  more  parsimonious,  additive,  congruent  model,  the  latter  is 
accepted. 

Order  table  analyses .  The  order  table  analysis  tests  the  following 
hypotheses. 

H3:  Location  on  the  cognitive  continuum  is  induced  by  surface  task 
characteristics,  irrespective  of  depth  task  characteristics. 

The  results  support  the  hypothesis.  Table  5  shows  that  in  the  aesthetic 
judgment  task,  the  three  surface  task  conditions  induced  cognition  to  be 
activated  in  exactly  the  predicted  order  on  the  cognitive  continuum  (formula 
(A)  >  bar  graph  (Q)  >  film  strip  (I))  for  eight  engineers  (X2  *  5.5,  p  <  .02). 
An  additional  nine  engineers  had  two  of  the  three  predicted  orders  (A  >  Q, 

S)  >  I,  and  A  >  I).  Three  engineers  had  two  departures  from  the  expected 
order,  and  one  engineer  had  three  (i.e.,  a  complete  reversal  of  the  predicted 
order).  Thus,  17  of  the  21  engineers  were  more  consistent  with  the  prediction 
than  chance:  that  is,  17  had  at  least  two  of  the  three  predicted  pairwise 
relationships  (X  -  6.86,  p  <  .01).  The  pattern  of  results  for  the  safety  and 
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capacity  tasks  is  similar.  The  same  result  appears  when  each  engineer's  CCI 
scores  are  averaged  across  the  three  depth  tasks  (right  hand  column’ of  Table 
5). 

Insert  Table  5  About  Here 


H4:  Location  of  cognitive  activity  on  the  cognitive  continuum  is 

induced  by  depth  task  characteristics,  irrespective  of  surface 
task  characteristics. 

The  results  support  the  hypothesis  (see  Table  6).  In  the  film  strip 

surface  task  condition  (left  column  of  Table  6),  the  three  depth  task 

conditions  induced  eight  engineers'  cognition  to  be  activated  on  the  cognitive 

continuum  in  exactly  the  predicted  order  (capacity  (C)  >  safety  (s)  > 

aesthetics  (E))  (p  <  .02),  six  engineers  to  have  one  deviation,  five  engineers 

to  have  two  deviations,  and  one  engineer  to  have  three  deviations  (i.e.,  a 

complete  reversal  of  the  expected  order).  Within  the  bar  graph  condition,  the 

number  of  engineers  having  the  expected  order  or  at  least  two  of  the  three 

relationships  was  significant.  Within  the  formula  condition  (Column  3),  and 

when  the  engineers'  CCI  was  averaged  across  all  three  surface  task  conditions 

(Column  4),  there  was  a  greater  than  expected  number  of  engineers  who  had 

exactly  the  predicted  order,  although  this  number  was  not  statistically 

significant.  However,  for  each  of  these  columns  18  engineers  had  at  least  two 

2 

of  the  three  predicted  relations  (X  *  11.25,  p  <  .001).  Thus,  although  depth 
task  conditions  (Table  6)  induced  the  expected  locations  of  cognitive  activity 
on  the  cognitive  continuum,  they  were  not  as  effective  as  surface  task 


conditions  (Table  5) 


Second  Direct  Comparison 
Hammond,  Hamm,  Grassia  and  Pearson 


Page  34 
31  May  84 


Summary 


Insert  Table  6  About  Here 


Correlational  analysis  showed  that  the  location  of  the  task  on  the  task 
continuum  has  the  expected  effect  on  the  location  of  the  engineer's  cognitive 
activity  on  the  cognitive  continuum.  Regression  analysis  supported  the 
hypothesis  that  congruence  between  depth  and  surface  task  characteristics  most 
strongly  induces  the  corresponding  cognitive  mode.  Order  table  analysis 
supported  the  correlational  analysis  and  showed,  in  more  detail,  the 
significant  effects  of  depth  and  surface  task  conditions  on  the  location  of 
the  engineers'  cognitive  activity  on  the  cognitiye  continuum. 

The  effects  of  surface  and  depth  task  characteristics,  over  the  ranges 

j 

manipulated  in  this  study,  are  of  approximately  the  same  magnitude,  although 

evidence  from  order  table  analysis  and  regressioh  analysis  indicates  that 

i 

surface  task  characteristics  may  be  more  powerful  than  depth  in  inducing 
cognitive  activity  to  conform  to  expectations.  The  regression  coefficients 
for  the  surface  task  variation  were  larger,  indicating  that  variation  in 

I 

surface  task  characteristics  as  measured  by  TCI  has  a  larger  effect  on  the 

I 

cognitive  mode  than  variation  in  depth  task  characteristics. 

Performance 

Analysis  as  ceiling.  Having  demonstrated  that  task  properties  induce 
corresponding  cognitive  properties,  we  can  now  turn  to  the  question  of  whether 
analytical  cognition  is,  in  practice,  always  superior  to  intuitive  and 
quasi-rational  cognition.  In  broad  terms,  the  answer  is  clearly  no.  When 
judging  capacity,  11  of  the  20  engineers  had  higher  achievement  in  the 
intuitive  (film-strip)  or  quasi-rational  (bar-graph)  condition  than  in  the 
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analytical  (formula-producing)  condition  (Table  7-A).  The  same  was  true  for 
11  of  the  21  engineers  when  judging  safety  (Table  7-B),  and  for  3  of  the  21 
engineers  when  judging  aesthetics  (Table  7-C).  Clearly,  analytical  cognition 
did  not,  in  practice,  provide  a  ceiling  which  could  not  be  exceeded  by 
intuitive  or  quasi-rational  cognition.  Before  proceeding  to  a  statistical 
examination  of  these  results  we  describe  the  role  of  extreme  errors  produced 
by  analytical  cognition. 


The  Extreme  Errors  of  Analytical  Cognition 


One  reason  that  analytical  cognition  fails  to  surpass  guasi-rational  and 
intuitive  cognition  consistently  is  that,  as  predicted,  more  extreme  errors 
are  made  by  this  ford  of  cognition.  As  Figure  5  illustrates,  in  the 
analytical  (formula)  surface  condition,  the  range  of  achievement  scores 

increases  dramatically  from  aesthetics  to  safety  to  capacity.  Thus  the  worst 

j 

as  well  as  the  best  performances  are  produced  by  analytical  condition. 


Insert  Figure  5  about  here 


Detailed  analysis  of  each  engineer's  performance  shows  how  such  errors 

I 

come  about.  Engineer!  #2,  for  example,  made  a  careless  arithmetic  error  in 
producing  the  weights  in  his  safety  formula.  He  first  assigned  a  weight  of 
.10  to  each  of  the  ten  cues.  Next  he  adjusted  the  weights  of  important  cues 
to  .12.  Finally,  intending  to  assign  weights  of  .08  to  cues  he  felt  were 
slightly  less  important ,  he  wrote  instead  .8.  Thus  he  gave  the  greatest 
weight  to  the  cues  to  which  he  wished  to  give  least  weight.  The  effects  of 
his  error  were  serious:  his  achievement  (r  )  was  only  .071,  and  his  mean 
error  was  44.2  on  a  scale  he  intended  to  run  from  0  to  32.  Similarly,  on  the 
capacity  task.  Engineer  #8  intended  to  subtract  a  set  of  factors  from  the 
maximum  capacity,  2500,  but  used  an  extra  minus  sign,  so  his  formula  produced 
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answers  that  correlated  negatively  with  the  capacity  criterion  (-.574). 
Correcting  this  error  and  another  minor  one  produced  a  formula  that  performed 
at  .879,  moving  him  from  being  the  worst  performing  engineer  to  the  best 
performing  engineer  on  this  task.  Errors  of  this  type,  capable  of  affecting 
the  engineer's  entire  performance,  appeared  more  often  in  the  formula 
condition  than  in  the  filmstrip  or  bar  graph  conditions. 

Further,  among  the  three  formula  conditions,  the  errors  became  more 
serious  as  the  depth  task  condition  became  more  analytical  (as  TCI  increased). 
The  seriousness  of  an  error  can  be  evaluated  by  the  correlations  of  the 
answers  produced  by  the  erroneous  formula  with  the  answers  produced  by  a 
corrected  formula.  Among  the  eight  engineers  with  erroneous  aesthetics 
formulas,  the  median  correlation  between  corrected  and  uncorrected  formulas  is 
.997,  indicating  that  the  errors  in  this  intuition-inducing  depth  task  were 
not  at  all  serious.  The  median  correlation  between  corrected  and  uncorrected 
formulas  for  the  seven  engineers  who  made  errors  on  their  safety  formulas  is 
.715,  and  the  median  for  the  nine  engineers  with  capacity  formula  errors  is 
.668.  Thus,  the  most  serious  errors  in  the  formula  condition  were  produced  in 
the  most  analysis-inducing  depth  task,  capacity  judgment. 

But  the  extreme  errors  of  analytical  cognition  are  no*-  the  only  reason 
why  it  is  frequently  outperformed  by  the  engineers'  intuitive  and 
quasi- rational  cognition.  Removing  the  effects  of  errors  by  using  the  measure 
G  from  the  Lens  Model  Equation  (see  Appendix  B)  shows  that  performance  in  the 
analytical  surface  task  is  exceeded  by  performance  in  the  intuitive  or 
qua si-rational  condition  for  12  of  the  20  engineers  on  the  capacity  task,  for 
1.3  of  the  21  engineers  on  the  safety  task,  and  for  14  of  the  21  engineers  on 
the  aesthetics  task.  Therefore,  in  practice,  analytical  cognition  does  not 
represent  an  upper  bourd  for  performance,  even  when  the  occasional  large 

/  ... 
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errors  in  its  execution  have  been  corrected. 

The  fragility  of  analysis,  illustrated  by  the  appearance  of  large  errors 
in  the  analytical  but  not  the  intuitive  >r  quasi-rational  surface  condition, 
was  first  emphasized  by  Brunswik  (1956,  p.  92),  who  contrasted  the  dangers 
from  the  errors  of  perception  with  the  errors  of  analyses  in  this  way: 

the  "stupidity"  of  perception  thus  is  by  no  means  to  be  construed  to 
mean  maladaptiveness ;  as  we  all  know,  life  has  survived  on  relative 
stupidity  from  time  immemorial,  and  if  threatened  in  its  existence 
it  is  so  by  malfunctioning  of  the  intellect  rather  than  by 
malfunctioning  of  perception. 

Hypotheses  Regarding  TC,  CCI ,  and  Performance 

The  principal  hypotheses  are  that  performance  will  be  best  (a)  when  the 
surface  task  characteristics  are  congruent  with  the  depth  task  characteristics 
and  (b)  when  the  engineer's  cognitive  mode  corresponds  to  the  task 
characteristics . 

Correlational  Analyses 

The  hypotheses  concerning  the  effects  of  congruence  and  correspondence  on 
performance  may  be  investigated  by  correlating  performance  measures  with 
measures  of  surface  and  depth  task  (TCI)  and  of  location  of  cognitive  activity 
(CCI),  as  well  as  with  indices  of  congruence  between  surface  and  depth  task 
and  of  correspondence  between  TCI  and  CCI.  Performance  is  measured  by 


achievement  (r  ) 
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Surface-depth  Congruence  and  Performance 

The  hypothesis  that  congruence  between  surface  and  depth  task 
characteristics  determines  performance  may  be  tested  by  creating  a  variable  ir. 
which  a  "2"  is  assigned  to  the  cells  on  the  descending  diagonal  (in  Figure  1), 
a  "1"  to  the  adjacent  cells,  and  a  "0"  to  the  corner  cells.  This  variable  is 
orthogonal  to  surface  and  depth  task  conditions. 

H5:  The  greater  the  congruence  between  surface  and  depth  task 
characteristics,  the  higher  the  engineer's  achievement. 

The  mean  of  the  z-transformations  of  the  correlations  between  r  and  the 

a 

measure  of  congruence  is  -.181  with  a  standard  error  of  +. 063  (corresponding 
to  a  correlation  of  -.179),  which  is  significally  different  from  zero 
(p  <  .01,  df  ■  20,  two-tailed).  These  results  suggest  that  congruence  between 
surface  and  depth  is  only  slightly  associated  with  higher  achievement.  The 
order  table  analysis  (below)  indicates  the  reason  for  this  result. 

Mode-task  Correspondence  and  Performance 

The  hypothesis  that  the  correspondence  of  the  engineer's  cognitive  mode 
to  the  task  determines  performance  may  be  investigated  by  measuring  the 
absolute  difference  between  the  location  of  each  engineer's  cognitive  activity^ 
on  the  cognitive  continuum  and  the  tack  location  on  the  task  continuum 
| TCI  -  CCI|. 

H6:  The  greater  |TCI  -  CCX|,  the  lower  the  engineer's  achievement 
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The  mean  z-transformed  correlation  between  |TCI  -  CCX|  and  r  is  -.370 

A 

+.067,  significantly  different  from  zero  (p  <  .001,  df  ■  20,  two-tailed). 

Thus,  the  results  indicate  that  performance  is  better  when  the  engineer’s 

cognitive  mode  corresponds  to  the  task's  location  on  the  cognitive  continuum. 

* 

Both  sets  of  results  support  the  importance  of  task  conditions:  the 
first  indicates  that  performance  is  better  when  surface  and  depth  aspects  of 
task  are  congruent.  The  second  indicates  that  performance  is  better  when 
cognitive  mode  corresponds  to  task.  These  results  contradict  the  conventional 
view  that  analytical  cognition  always  leads  to  higher  performance. 

Order  Table  Analysis 

The  hypotheses  concerning  the  effects  of  surface/depth  congruence  and 
mode/ task  correspondence  on  performance  were  also  investigated  with  the  order 
table  method. 


Surface/Depth  Congruence 


Whereas  the  correlational  analysis  of  the  surface/depth  congruence 
hypothesis  investigated  the  relatior  ship  between  performance  and  a  measure  of 
surface/depth  congruence  over  all  nine  cells  of  the  study  design  (Figure  1), 
the  order  table  analysis  investigates  the  relationship  within  each  row,  that 
is,  for  each  depth  task.  The  order  table  analysis  allows  us  to  pinpoint 
conditions  that  agree  or  disagree  with  the  hypothesis  because  it  provides  a 


more  detailed  investigation  of  the  relationship 


Hip. 


H7»  Achievement  ( r^ )  should  be  best  wnen; 


the  surface  and  depth  task 
conditions  are  congruent.  That  is,  they  should  be  in  the  order 
I  >  D  >  A,  (e.g.,  r&  greater  in  film  strip  than  bar  graph  than 


formula)  for  the  intv\ic\on-inducing  aesthetics  judgment  task 
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in  the  order  A  >  Q  >  I  (i.e.,  formula  >  bar  graph  >  film  strip) 
for  the  analysis-inducing  capacity  judgment  task,  and  in  the 
order  Q  >  1  >  A  or  £  >  A  >  I  for  the  quasi  rationality  inducing 
safety  judgment  task. 

The  results  regarding  achievement  clearly  disconfirm  Hypothesis  7.  The  fir. 
columns  of  Tables  7A,  7B,  and  7C  show  that  although  the  predicted  results  were 
found  in  the  analysis-inducing  depth  conditions  ( capacity) ,  the  opposite 
results  were  found  in  the  intuition-inducing  depth  conditions  (aesthetics)  and 
no  significant  results  were  found  in  the  quasi  rationality  inducing  depth 
conditions  (safety). 

insert  Table  7  about  here 


A  competing  hypothesis  is  the  conventional  one: 

H8:  Cognition  in  analysis-inducing  surface  task  conditions  is  best 
for  all  engineers  across  all  tasks. 

The  results  regarding  achievement  support  Hypothesis  8  (see  column  1  of  Tables 
7A,  7b  and  7C);  there  is  evidence  for  achievement  being  in  the  A  >  Q  >  I 
order  in  each  of  the  depth  conditions;  this  was  especially  true  for 
aesthetics . 

Mode/Task  Correspondence 

Whereas  the  correlational  analysis  of  the  mode/task  correspondence 
hypothesis  investigated  the  relationship  between  performance  and  a  measure  of 
the  extent  to  which  the  engineer's  location  on  the  cognitive  continuum  was 
similar  to  the  task's  location  on  the  task  continuum,  |TCX  -  CCX|,  over  all 
nine  cells  of  the  study  design,  the  order  table  analysis  indicates,  for  each 
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depth  task  condition,  whether  the  engineer's  performance  is  best  when  his 
cognitive  mode,  however  induced,  corresponds  to  the  characteristics  of  that 
depth  condition.  For  example,  if  on  the  capacity  task  the  engineer's 
cognitive  mode  was  more  analytic  in  the  bar  graph  condition  than  in  the 
formula  condition,  then  his  performance  should  be  better  in  the  bar  graph 
condition  than  in  the  formula  condition  because  the  capacity  task  is  predicted 
to  induce  analysis.  Specifically, 

H9:  The  order  of  magnitude  of  achievement  (r  )  in  the  aesthetics 

A 

task  should  be  I'  >  £>'  >  A',  in  the  safety  task  Q'  >  I'  and 
Q'  >  A',  and  in  the  capacity  task  A'  >  Q*  >  Z'. 

Here  I'  is  the  surface  condition  in  which  the  engineer's 
cognition  is  most  intuitive  for  a  given  depth  condition.  A'  is 
the  surface  condition  in  which  his  cognition  is  most 
analytical,  and  Q'  is  the  condition  in  between. 

The  results  regarding  achievement  (third  column  of  Table  7)  are  similar 
to  those  concerning  the  surface/depth  congruence  hypothesis.  That  is,  in  the 
capacity  condition,  seven  of  the  engineers  had  the  expected  order 
A'  >  fi*  >  I',  and  ten  had  only  one  deviation  from  it.  However,  in  the  safety 
condition  the  number  of  engineers  who  had  the  expected  order  was  not  above 
chance,  and,  again,  in  the  aesthetics  condition  the  results  were  opposite  from 
the  prediction. 

H10:  Achievement  (*ft)  is  highest  for  all  engineers  across  all  tasks 
in  the  analytical  (formula  producing)  conditions. 
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The  results  partially  support  this  hypothesis;  at  least  two  of  the  three 
expected  relations  hold  for  17  (p  <  .01},  12  (n.s.),  and  15  {p  <  .05} 
engineers  in  the  capacity,  safety,  and  aesthetics  conditions,  respectively. 

Engineers  *  successful  prediction  of  the  aesthetics  criterion  by 
construction  of  formulas .  Eighteen  of  the  21  engineers  were  most  accurate  in 
predicting  the  aesthetic  value  of  the  highways  by  means  of  a  formula  (in 
contrast  to  visual  inspection  1 ) .  Moreover,  judgments  made  by  the  engineers  in 
all  surface  conditions  of  the  aesthetics  task  were  highly  accurate  (mean 
r  «  .91).  Such  high  accuracy  is  rarely  seen  in  studies  of  expert  judgment, 

A 

and  such  high  accuracy  in  an  aesthetics  task  by  means  of  an  equation  was 
particularly  surprising.  And  it  is  the  high  accuracy  in  this  condition  that 
produces  the  low  correlations  between  mode/task  correspondence  and 
performance . 

Consideration  of  this  anomaly  is  instructive  for  several  reasons. 

Examination  of  the  nature  of  the  criterion  and  the  nature  of  the  formulas 

produced  would  have  made  the  result  highly  predictable,  had  this  information 

been  available  prior  to  the  collection  of  data  because  (a)  the  TCI  value  for 

the  aesthetics  task  was  3.156,  the  lowest,  as  it  should  have  been,  for  all 

tasks;  (b)  the  criterion  for  aesthetics  was  developed  from  perceptual 

judgments  of  the  highways  from  film  strips  and  photographs  by  ninety-one 

citizens;  (c)  the  cues  were  rather  highly  intercorrelated  (r  “  .556);  and 

(d)  the  linear  predictability  of  the  citizens'  judgments  was  essentially 
2 

perfect  (R  -  .99).  These  task  properties  imply  that  if  the  engineers  were  to 
produce  linear,  additive  formulas  (e.g.,  a  weighted  sum  formula)  such  formulas 
would  be  highly  accurate,  even  if  their  weights  were  far  different  from  those 
used  by  the  citizens.  And  that  is  what  happened;  15  of  the  engineers  did 
construct  linear  additive  formulas  (in  contrast  to  4  in  both  the  safety  task 


Page  42 
31  May  84 


Second  Direct  Comparison 
Hammond,  Hamm,  Grass ia  and  Pearson 


Page  43 
31  May  84 


# 


* 


# 


o 


Q 


O 


and  the  capacity  ta'k),  and  the  remaining  formulas  consisted  of  only  minor 
deviations  from  this  type. 

Most  important  is  the  reason  why  the  engineers  used  this  type  of 
equation;  their  explanations  (taken  from  the  "think-aloud"  procedure  and 
post-test  interviews)  indicate  that  the  engineers  had  never  attempted  such  a 
task  before,  that  they  had  no  conceptual  means  for  coping  with  it,  and, 
therefore,  they  could  think  of  no  solution  other  than  to  "add  up  the  factors," 
and  thus  produce  a  weighted  sum.  Thus,  they  made  explicit  use  of  the  same 
organizing  principle  implicitly  used  by  the  members  of  the  citizens'  panel 
(and  themselves;  when  judging  the  highways  by  perceptual  means. 

Use  of  the  same  organizing  principle  would  not,  however,  account  for  the 
superior  performance  of  the  formulas  created  by  the  engineers  over  the  other 
two  sets  of  judgments.  Superior  performance  was  achieved  because  the  same 
organizing  principle  was  applied  inconsistently  in  the  intuition-inducing  and 
quasi-rationality-inducing  surface  conditions,  but  was  applied  with  perfect 
consistency  ( and,  as  we  showed  above,  with  negligeable  error)  in  the 
analysis-inducing,  formula  condition.  The  lens  model  equation  (see  Appendix 
B)  provides  a  measure  of  performance  (G)  when  the  effects  of  inconsistency  and 
error  are  removed.  Column  2  of  Table  7-C  presents  the  order  table  analysis  of 
G  for  aesthetics.  While  the  order  over  the  surface  conditions  is  still  in  the 
reverse  direction  for  the  majority  of  engineers,  the  result  is  not 
statistically  significant.  This  result  suggests  that  the  unexpectedly  high 
achievement  of  the  engineers'  formulas  can  be  explained  by  the  fact  that  the 
organizing  principle  explicitly  adopted  by  the  engineers  is  identical  with  the 
intuitive  organizing  principle.  This  principle  is  applied  consistently  in  the 
analytical  surface  condition.  It  is,  however,  applied  inconsistently  in  the 
intuitive  and  quasi-rational  surface  conditions,  and  therefore  performance  in 
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the  latter  conditions  is  lower  than  that  in  the  analytical  condition. 

Summary  and  Discussion  of  Performance  Analyses 

The  correlational  analysis  shows  that  achievement  is  higher  when  surface 
task  properties  are  congruent  with  depth  task  properties,  and  when  location  of 
the  engineer's  cognitive  activity  corresponds  to  the  task's  location  on  the 
task  continuum.  But  the  relationship  was  weak. 

The  order  table  analyses  provided  an  explanation  for  the  generally  low 
correlations.  Although  the  order  of  performance  among  the  surface  task 
conditions  corresponded  to  the  expected  order  for  most  engineers  in  the 
capacity  depth  task  condition,  the  relation  was  weak  in  the  safety  depth  task 
condition,  and  was  reversed  fn-  most  engineers  in  the  aesthetics  depth  task 
condition.  Therefore,  it  is  the  engineers'  high  achievement  (mean  r  =  .91) 

cl 

in  the  analytical  formula-producing  condition  of  the  aesthetic  task  that  is 
responsible  for  the  weak  relation  between  achievement  and  correspondence 
between  TCI  and  CCI.  Examination  of  the  properties  of  the  derivation  of  the 
criterion  for  the  aesthetics  task  showed  that  it  had  linear,  additive 
structure,  which,  together  with  the  engineers  unwitting  but  more  consistent 
use  of  a  similar  organizing  principle,  accounted  for  the  anomalous  result. 

Summary 

We  began  this  article  by  drawing  a  distinction  between  indirect  and 
direct  comparisons  of  intuitive  and  analtyical  cognition.  We  indicated  that 
indirect  comparisons  inform  us  about  the  proportion  of  persons  in  various 
populations  whose  intuitive  and  quasi-rational  judgments  fail  to  achieve  the 
various  standards  or  models  of  analytical  cognition  under  various 
circumstances.  Direct  comparisons,  on  the  other  hand,  inform  us  about  the 
relative  efficacy  of  intuitive,  quasi-rational  and  analytical  cognition  (as 
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the  latter  is  actually  employed)  compared  to  an  empirical  criterion  (rather 
than  a  product  of  a  logical  model)  under  various  conditions  and  within  various 
populations.  Although  many  indirect  comparisons  have  been  made  (see 
especially  Kahneman  et  al.,  1982)  we  can  find  no  previous  direct  comparisons. 

Direct  comparisons  were  made  by  ascertaining  the  relative  efficacy  of 
twenty-one  expert  highway  engineers'  use  of  intuition,  quasi  rationality  and 
analysis.  Each  engineer  was  studied  individually  over  nine  conditions,  each 
of  which  was  located  on  a  task  continuum  index  (TCI)  defined  in  terms  of  eight 
measures  selected  a  priori.  The  subjects'  cognitive  activity  in  each  of  the 
nine  conditions  was  located  on  a  cognitive  continuum  index  (CCI)  defined  in 
terms  of  the  subjects'  performance  on  four  measures,  also  selected  a  priori. 
Both  continua  ran  from  intuition  through  quasi  rationality  to  analysis. 

The  results  of  the  direct  comparison  of  intuitive,  quasi-rational  and 
analytical  cognition  described  above  indicate  not  only  that  intuitive  and 
quasi-rational  cognition  can  perform  as  well  as  human  analytical  cognition, 
but  that  superior  performance  can  occur  frequently:  intuitive  or 
quasi-rational  cognition  outperformed  analytical  cognition  for  roughly  half 
the  subjects  on  at  least  one  occasion. 

More  specific  predictions  were  made  regarding  the  relations  between  the 
TCI  and  the  CCI.  The  first  prediction  was  that  task  properties  would  induce 
corresponding  cognitive  properties;  that  is,  the  location  of  each  task 
condition  on  the  TCI  would  induce  each  subject's  cognitive  activity  to  be 
activated  at  a  corresponding  position  on  the  CCI.  The  results  generally 
supported  this  prediction,  which  was  a  necessary  precondition  for  the  second 
prediction. 
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The  second  prediction  was  that  the  closer  the  correspondence  between  task 
location  on  the  TCI  and  the  subject's  cognitive  location  on  the  CCI,  the  more 
accurate  the  expert's  judgment  would  be.  The  results  suggested  a  weak 
relationship  that  was  unanticipated,  but  understandable  given  the  nature  of 
the  aesthetics  criterion  and  the  additive  formulas  used  by  the  engineers. 

Thus,  the  relative  efficacy  of  different  modes  of  cognition— including 
analytical  cognition— varies  with  task  properties.  Future  research  will  need 
to  focus  on  the  specification  of  how  task  properties  combine  to  induce 
tog? .  !-ion  to  change  and  how  such  changes  affect  performance. 

These  results  have  two  types  of  implications,  those  concerned  with  the 
relative  efficacy  of  different  forms  of  cognition,  and  those  concerned  with 
the  use  of  cognitive  continuum  theory.  With  regard  to  relative  efficacy,  the 
results  imply  that,  in  practice,  the  efficacy  of  analytical  cognition  does  not 
invariably  surpass  the  efficacy  of  intuitive  or  quasi -rational  cognition,  even 
when  the  decrement  in  performance  caused  by  the  large  errors  of  analysis  is 
eliminated.  The  relation  between  task  properties  and  cognitive  properties  may 
be  a  better  predictor  of  efficacy. 

With  regard  to  the  use  of  cognitive  continuum  theory  the  results  imply, 
first,  that  the  general  index  of  task  location  (or  an  improved  version  of  it) 
can  be  used  to  describe  any  cognitive  task.  Thus,  tasks  used  by  various 
investigators  can  be  directly  compared  to  one  another  with  regard  to  their 
location  on  the  TCX.  Identification  of  TCI  locations  of  the  various  tasks 
used  by  researchers  would  thus  show  the  complementarity  of  much  of  the  current 
work  in  cognition  that  now  mistakenly  appears  to  be  competitive.  For  example, 
discovery  of  the  TCI  for  say,  Anderson's  (1981)  work  on  children's  perception 
of  rectangularity  and  the  TCI  for  Simon's  work  on  the  puzzle  of  the  Tower  of 
Hanoi  and  similar  analysis-inducing  problems  (1979)  would  permit  the 


Second  Direct  Comparison 
Hammond,  Hamm,  Grassia  and  Pearson 


Page  47 
31  May  84 


recognition  of  the  complementarity  of  these  endeavors. 

Second,  the  general  index  of  cognitive  location  (or  an  improved  version 
of  it)  can  be  used  to  described  cognition  in  any  cognitive  task.  Use  of  this 
index  together  with  the  index  of  task  location  can  lead  to  the  achievement  of 
cumulative  results,  a  feature  of  research  badly  needed  (see,  for  example, 
Meehl,  1978,  who  makes  a  strong  plea  for  efforts  to  establish  cumulative 
results) .  For  example,  if  differential  task  location  can  show  the  work  of 
Anderson  and  Simon  to  be  complementary,  then  the  description  of  the  results  of 
such  work  in  the  common  terms  of  the  index  of  cognitive  activity  would  allow 
each  set  of  results  to  be  incorporated  in  a  general  theory  and  thus  become 
cumulative . 

Xn  short,  the  two  indices  provide  a  means,  and  thus  an  opportunity,  for 
unifying  the  work  in  cognitive  psychology. 


Second* Direct  Comparison 
Hammond,  Hamm,  Grassia  and  Pearson 


Page  48 
31  May  84 


References 

Adelman,  L.  (1981),  The  influence  of  formal,  substantive,  and  contextual 
task  properties  on  the  relative  effectiveness  of  different  forms  of 
feedback  in  multiple-cue  probability  learning  tasks.  Organizational 
Behavior  and  Human  Performance ,  27,  423-442. 

Anderson,  N.  H.  (1981).  Foundations  of  information  integration  theory.  New 
York:  Academic  Press. 

Beach,  L.  R. ,  &  Mitchell,  T.  R.  (1978).  A  contingency  model  for  the 
selection  of  decision  strategies.  Academy  of  Management  Review, 

439-449. 

Srehmer,  B.  (1978).  Response  consistency  in  probabilistic  inference  tasks. 
Organizational  Behavior  and  Human  Performance,  22.  103-115. 

Brehmer,  B. ,  &  Kuylenstierna,  J.  (1980).  Content  and  consistency  in 
probabilistic  inference  tasks .  Organizational  Behavior  and  Human 
Performance ,  26(1),  54-64. 

Brooks,  L.  (1978).  Nonanalytic  concept  formation  and  memory  for  instances. 
In  E.  Rosch  and  B.  Lloyd  (Eds.),  Cognition  and  cate gorl zatlon .  New  York: 
Erlbaum,  pp.  170-211. 

Brunswik,  E.  (1952).  The  conceptual  framework  of  psychology.  In 

International  encyclopedia  of  unified  science  (Vol.  1,  No.  10).  Chicago: 


University  of  Chicago  Press 


Second  Direct  Comparison 
Hammond,  Hamm,  Grassia  and  Pearson 


Page  49 
31  May  84 


Brunswik,  E.  (1956).  Perception  and  the  representative  design  of 

psychological  experiments  (2nd  ed.).  Berkeley:  University  of  California 
Press. 

Brunswik,  E.  (1957).  Scope  and  aspects  of  the  cognitive  problem.  Zn  H. 
Gruber,  R.  Jessor,  &  K.  Hammond  (Eds.),  Cognition:  The  Colorado 
Symposium.  Cambridge,  Ma:  Harvard  University  Press,  pp.  5-31 

Chi,  M.  T.  H. ,  Glaser,  R. ,  &  Rees,  E.  (1982).  Expertise  in  problem  solving. 
In  R.  Sternberg  (Ed.),  Advances  in  the  psychology  of  human  Intelligence 
(Vol.  1).  Hillsdale,  NJ:  Erlbaum,  pp.  7-75. 

Cohen,  L.  J.  (1981).  Can  human  irrationality  be  experimentally  demonstrated? 
The  Behavioral  and  Brain  Sciences,  4(3),  317-370. 

Dawes,  R.  M. ,  &  Corrigan,  B.  (1974).  Linear  models  in  decision  making. 
Psychological  Bulletin,  8H2),  95-106. 

Einhoro,  H.  J.  (1971).  Use  of  nonlinear,  noncompensatory  models  as  a 

function  of  task  and  amount  of  information.  Organizational  Behavior  and 
Human  Performance,  6(1),  1-27. 

Einhorn,  H.  J.,  6  Hogarth,  R.  M.  (1981).  Behavioral  decision  theory: 

Processes  of  judgment  and  choice.  Annual  Review  of  Psychology,  32,  53-88. 

Einhorn,  H. ,  &  Hogarth,  R.  (1982)  Reply  to  commentaries.  Zn  Ungson  & 
Braunstein  (Eds.),  Decision  making:  An  interdisciplinary  inquiry . 

Boston:  Kent,  pp.  53-56. 

Goldsberry,  B.  S.  (1983).  Induced  judgment  decrements  (Technical  Report  No. 
83-3).  Houston,  TX:  Rice  University,  Department  of  Psychology. 


Second  Direct  Comparison 
Hammond,  Hamm,  Grassia  and  Pearson 


Page  50 
31  May  84 


Hammond,  K.  R.  (1955),  Probabilistic  functioning  and  the  clinical  method. 
Psychological  Review,  62(4) ,  255-262. 

Hammond,  K.  R.  (Ed.).  (1966).  The  psychology  of  Egon  Brunswik.  Hew  York: 

Holt,  Rinehart,  &  Winston. 

Hammond,  K.  R.  (1980).  The  integration  of  research  in  judgment  and  dacision 
theory  (Report  Ho.  226).  Boulder:  University  of  Colorado,  Center  for 
Research  on  Judgment  and  Policy. 

Hammond,  X.  R.  (1982).  Unification  of  theory  and  research  in  judgment  and 
decision  making.  Boulder:  University  of  Colorado,  Center  for  Research  on 
Judgment  and  Policy. 

Hammond,  K.  R. ,  &  Brehmer.  B.  (1973).  Quasi-rationality  and  distrust: 

Implications  for  international  conflict.  In  L.  Rappoport  £  D.  Summers 
(Eds.),  Human  judgment  and  social  interaction.  Hew  York:  Holt,  Rinehart, 
and  Winston,  pp.  338-391. 

Hammond,  K.  R. ,  McClelland,  G.  H.,  &  Mumpower,  J.  (1980).  Human  judgment  and 
•  decision  making;  Theories ,  methods ,  and  procedures.  Hew  York:  Praeger. 

Hammond,  K.  R. ,  Stewart,  T.  R. ,  Brehmer,  B. ,  &  Steinmann,  D.  O.  (1975). 

Social  judgment  theory.  In  M.  F.  Kaplan  &  S.  Schwartz  (Eds.),  Human 
judgment  and  decision  processes.  Hew  York:  Academic  Press,  pp.  271-312. 

Hammond, |  K.  R. ,  &  Summers,  D.  A.  (1972).  Cognitive  control.  Psychological 
Review,  79,  58-67. 

Highway  Research  Board.  (1965).  Highway  Capacity  Manual  1965  (Highway 
Research  Board  Special  Report  Ho.  87,  national  Research  Council 
Publication  1328).  Washington,  DC:  Rational  Research  Council. 


Second  Direct  Comparison 
Hammond,  Hamm,  Grassia  and  Pearson 


Page  51 
31  May  64 


Hoch,  S.  J,  &  Tschirgi,  J.  E.  (1983).  Cue  redundancy  and  extra  logical 
inferences  in  a  deductive  reasoning  task.  Memory  and  Cognition,  11, 
200-209. 

Howell,  W. ,  &  Kerkar,  S.  (1982).  A  test  of  task  influence  in  uncertainty 
measurement.  Organizational  Behavior  and  Human  Performance ,  30,  365-390. 

Jones,  C. ,  &  Harris,  P.  (1982).  Insight  into  the  law  of  large  numbers:  A 
comparison  of  Piagetian  and  judgment  theory.  Quarterly  Journal  of 
Experimental  Psychology,  34A,  479-488. 

Jungermann,  H.  (1983).  The  two  camps  on  rationality.  In  R.  Scholz  (Ed.), 

Decision  making  tinder  uncertainty.  Amsterdam:  North  Holland,  pp.  ??????? 

Kahneman,  D, ,  Slovic,  P. ,  &  Tversky,  A.  (1982).  Judgments  under  uncertainty: 
Heuristics  and  biases.  New  York:  Cambridge  University  Press. 

Kahneman,  D. ,  £  Tversky,  A.  (1982).  On  the  study  of  statistical  intuitions. 
Cognition,  .11,  123-141. 

Kyburg,  H.  (1983).  Rational  belief.  Behavioral  and  Bralr.  Sciences ,  6, 
231-274. 

Meehl,  P.  E.  (1978).  Theoretical  risks  and  tabular  asterisks:  Sir  Karl,  Sir 
Ronald,  and  the  slow  progress  of  soft  psychology.  Journal  of  Consulting 
and  Clinical  Psychology,  46,  806-634. 

Miller,  A.  I.  (1978).  Visualization  lost  and  regained:  The  genesis  of  the 
quantum  theory  in  the  period  1913-27.  In  J.  Wechsler  (Ed.);  On  aesthetics 
in  science.  Cambridge,  Mass.:  MIT  Press,  pp.  73-102. 


Second  Direct  Comparison 
Hammond,  Hamm,  Grass ia  and  Pearson 


Page  52 
31  May  84 


m 


Payne,  J.  (1976).  Task  complexity  and  contingent  processing  in  decision 
making:  an  information  search  and  protocol  analysis.  Organizational 
Behavior  and  Human  Performance,  16,  366-387. 

Payne,  J.  (1982).  Contingent  decision  behavior.  Psychological  Bulletin,  92, 
382-402 . 

Pennington,  N.  (1982,  November).  Comments  on  Tversky  and  Kahneman's 

"Xntensional  reasoning  and  the  conjunction  fallacy".  Paper  presented  at 
the  meeting  of  the  Judgnent/Decision  Making  Society,  Minneapolis,  MN. 

Pits,  G.  F. ,  &  Sachs,  N.  J.  (1984).  Judgment  and  decision;  Theory  and 
applications.  Annual  Review  of  Psychology,  35,  139-163. 

Rosen,  S.  (1980).  The  limits  of  analysis .  New  York:  Basic  books. 

Royce,  J.  R.  (1978).  Three  ways  of  knowing,  and  the  scientific  world  view. 
Methodology  and  Science,  1 1 ,  146-164. 

Simon,  H.  A.  (1979).  Models  of  thought.  New  Haven:  Yale  University  Press. 

Simon,  H.  A.  (1957).  Models  of  man.  New  York:  Wiley. 

Stewart,  T.  R.  (1976).  Components  of  correlation  and  extensions  of  the  lens 
model  equation.  Psychometrlka ,  41 ,  101-120. 

Tversky,  A. ,  *  Xahneman,  D.  (1983).  Extensional  versus  intuitive  reasoning: 
The  conjunction  fallacy  in  probability  judgment.  Psychological  Review, 
90(4),  293-315. 

Wallsten,  T.  S. ,  &  Budescu,  D.  V.  (1981).  Addivity  and  nonaddivity  in 
judging  MMPI  profiles.  Journal  of  Experimental  Psychology;  Human 
Perception  and  Performance,  7(5),  1096-1109. 


* 


& 


* 


v# 


^0 


Second  Direct  Comparison 
Hammond,  Hamm,  Grass ia  and  Pearson 


Page  53 
31  May  84 


Wason,  P.,  &  Johnson-Laird,  P.  (1972).  Psychology  of  reasoning:  Structure 
and  content.  Cambridge,  MA:  Harvard  University  Press. 

Wyer,  R.  (1976).  An  investigation  of  the  relations  among  probability 
estimates.  Organizational  Behavior  and  Human  Performance,  15,  1-18. 


Second  Direct  Comparison 
Hammond,  Hamm,  Grassia  and  Pearson 


Page  54 
31  May  84 


Author  Notes 

This  research  was  supported  by  the  Engineering  Psychology  Programs, 
Office  of  Naval  Research,  Contract  N00014-81-C-0591 ,  Work  Unit  Number  N,. 
197-073  and  by  BRSG  Grant  #RR070 13-14  awarded  by  the  Biomedical  Research 
Support  Program,  Division  of  Research  Resources,  NIH.  Center  for  Research  on 
Judgment  and  policy.  Institute  of  Behavioral  Science,  University  of  Colorado. 
Reproduction  in  whole  or  in  part  is  permitted  for  any  purpose  of  the  United 
States  Government.  Approved  for  public  release;  distribution  unlimited. 


Second  Direct  Comparison 
Hammond,  Hamm,  Gras si a  and  Pearson 


Page  55 
31  May  84 


Table  1 


Task  Continuum  Index  (TCI )  Values  for  Each  Cell  of  Study  Design  and  for 
Each  Depth  Condition  (Row  Marginals)  and  Surface  Condition  (Column 
Marginals ) 


I  I  I 

|  Quasi  |  |  Depth  Task 

Intuition  |  Rationality  |  Analysis  j  Index  (mean) 


|  Aesthetics 
| 

1.844 

3.531 

4.094 

3. 156 

1  Safety 

5.377 

6.904 

7.466 

6.582 

|  Capacity 

6.957 

8.564 

9.127 

8.216 

' 

1  1 
|  Surface  Task  | 

|  Index  (mean)  |  4.7 

1 

26 

_ 

6.333 

_ . _ 

6.896 

Aesthetics ;  In ter cor relation 3  a.r.onq  Cues 
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ATTR,  attractiveness  of  design  COLOR,  color 

RDCON,  road  condition  VEG,  vegetation 

SCENE,  scenery  TERRAIN,  type  of  terrain 

CUL,  amount  of  roadside  culture  AESTHETICS,  aesthetics  criterion 

LNDSCP,  amount  of  reparative  landscape 


LWIDTH,  lane  width;  GRADE,  percent  with  substantial  grade;  AVESL,  average  speed  limit; 

SWIDTH,  shoulder  width;  TRAFVOL,  traffic  volume;  OBSPM,  obstacles  per  mile; 

PCTNPZ,  percent  no  passing  zone;  TRAFMIX,  traffic  mix  (percent  trucks);  ACCRATE,  total  accident  rate 

CURVE PM,  curves  per  mile;  INTPM,  intersections  per  mile; 
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LWIDTH,  lane  width  TERRAIN,  type  of  terrain 

LATCLEAR,  lateral  clearance  ASGRADE,  angle  of  steepest  grade 

SIDEOBS,  side  obstacles  LSGRADE,  length  of  steepest  grade 

INTPM,  intersections  per  mile  AVESL,  average  speed  limit 

TRAFMIX,  traffic  mix  (percent  trucks)  CAPACITY,  DOH  capacity  criterion 
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•Call  values  «r«  expected  end  observed  nuabers  of  engineers  exhibiting  each  possible  CCI  order  aoong  the  capacity  CC> 
Safety  (S)  and  Aesthetics  (E)  depth  task  conditions. 


Surface-Depth  |  Mode-Task 

Congruence  |  Correspondence 

Hypothesis  |  Hypothesis 
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Congruence  |  Correspondence 

Hypothesis  |  Hypothesis 
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Figure  Captions 


Figure  _1  • 

Figure  2. 

Figure  3^ 

Figure  4. 

Figure  5. 


Design  of  the  study. 

Frame  from  film  strip  of  a  two-lane  rural  Colorado  highway. 

Bar  graph  presenting  safety-relevant  information  about  a  highway. 
Example  formulas  for  aesthetics,  safety,  and  capacity. 

Medians  and  ranges  of  achievement  in  each  condition. 


HIGHWAY  JUDGMENT  PROJECT  1982 


BAR  GRAPH  PRESENTATION. 


CAPACITY  JUDGMENT  TASK. 


Lane  Width 


Lateral  Clearance 


Obstructions 


Intersections  per  Mile 


8  10 
xxxxxxxxxxxxxxx 


0  2 
xxxxxxxxxxx 


0  2 
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 


0  4 

XX.'  xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 


Traffic  Mix 


0  24 

xxxxxxxxxxxxxxxxxxxxxxxxxx 


Terrain 


1  3 

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 


Angle  of  Steepest  Grade 


Length  of  Steepest  Grade 


<3  3.6 

XXXXXXXXXXX XX 


0  .17 

xxxxxxxxxxxxxx 


Average  Speed  Liait 


30  45 

xxxxxxxxxxxxxxxxxxx 


AESTHETICS  FORMULA 


AESTHETICS  VALUE 


3  3  9 

-  *  ATTR  +  - -  *  RDCON  +  -  *  SCENE 

16  16  64 


3  9  9 

- - *  CUL  + - *  LNDSCP  + - *  COLOR 

16  32  56 


9  9  149 

+  — —  *  VEG  + - *  TERRAIN - 

56  16  112 


SAFETY  FORMULA: 


ACCIDENT  RATE 


12.8  *  (23  -  (SWIDTH  +  LWIDTH) ) 


12.8  *  (OBSPM  +  CURVEPM  +  INTPM) 


6.4  *  (TRAFMIX  +  PCTNPZ) 
115 


CAPACITY  FORMULA: 


CAPACITY 


-  2  *  (LWIDTH  -  8)  -  .25  *  TRAFMIX 


-  2  *  INTPM  -  .25  *  (AVESL  -  30) 

-  1.5  *  (ASGRADE  -  3)  -  3  *  LSGRADE 


♦  .5  *  SIDEOBS  *  (LATCLEAR  -  6) 


+  .33  *  TERRAIN 


Note:  Variables  for  aesthetics,  safety  and  capacity  formulas  are  defined 
in  Tables  2,  3,  and  4  respectively. 


£  “  Aesthetics  Judgment 
S  “  Safety  Judgment 
C  ■  Capacity  Judgnent 


K 
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APPENDIX  A 

Maximal  Guidance  Procedure 

This  procedure  was  designed  to  give  the  engineer  a  maximum  of  guidance  in 
constructing  his  formula  for  safety  in  order  to  prevent  the  commission  of 
minor  errors  and  to  ensure  that  his  formula  adhered  to  principles  of 
measurement  theory  with  which  he  might  not  be  familiar.  The  procedure 
consisted  of  the  following  steps: 

—  Specify  the  answer  scale . 

--  Specify  the  scale  for  each  input  dimension  and  its  overall  relation  to 
the  answer  scale,  and  identify  possible  interactions  with  other 
dimensions. 

~  Group  the  input  dimensions  according  to  their  redundancy,  similarity, 
or  mutual  interactions. 

— *  Express  the  formula  as  a  hierarchy  of  groups  of  variables. 

--  Determine  what  organizing  principle  should  be  used  at  each  level  of 
hierarchy. 

~  Specify  the  function  form  governing  each  dimension's  input  to  its 
organizing  principle. 

--  Combine  all  the  above  information  into  one  formula. 
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The  engineer  was  guided  through  these  steps  by  a  series  of  forms  which 
contained  instructions  for  the  steps  and  choice  points,  and  on  which 
intermediate  steps  were  recorded.  Two  examples  follow.  The  engineer  also 
received  detailed  tutorials  about  interactions  and  organiaj.ng  principles  as 
part  of  the  maximal  guidance  procedure. 
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Form  1:  Answer  Dimension  Form 


Name  _  Task  _ 

Answer  dimension's  units  _ . 

Range  of  possible  answers:  Low  _____  High 


A  "natural  0"  on  a  scale  means  that  when  it  is  called  "0"  there  really  is 
NONE  of  the  quality  being  measured.  Zf  you  had  a  natural  0,  then  it  would 
make  sense  to  say  that  an  ”8"  is  twice  as  much  of  a  thing  as  a  "4";  but  if 
the  0  was  arbitrary,  it  wouldn't  have  that  sort  of  meaning. 

For  example,  if  you  have  savings  of  $10,000,  you  have  twice  as  much  money 
as  if  you  had  $5000,  because  10000  is  twice  5000.  Here  the  $0  is  a  natural 
But  32  degrees  F  is  not  twice  as  warm  as  16  degrees  F,  because  the  0  on  the 
temperature  scale  is  picked  arbitrarily.  In  other  words,  it  does  not  have  a 
natural  0. 

Does  the  answer  dimension  have  a  natural  0?  Yes  _  No _ . 

It  is  useful,  when  considering  numbers  that  measure  a  dimension,  to  ask 
whether  the  intervals  between  the  numbers  have  consistent  meaning,  or  whether 
the  numbers  simply  express  order.  For  example,  is  the  difference  between  a  1 
and  a  2  the  same  as  the  difference  between  an  11  and  a  12?  Zn  the  above 
measures  of  money  or  temperature,  the  intervals  do  have  consistent  meaning. 
However  if  we  were  to  assign  numbers  to  grades  on  a  test,  where  A  ■  1,  B  *  2, 

C  ■  3,  D  ■  4,  E  -  5,  and  F  «  6,  the  interval  between  2  and  4  would  be 
different  in  meaning  from  the  interval  between  4  and  6.  All  the  numbers 
convey  is  that  A  is  better  than  B,  etc. 

Do  the  intervals  in  the  answer  scale  have  a  consistent  meaning? 

Yes  No  . 
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Form  3  s  Choice  of  Organizing  Prir.jiple 


This  form  is  for  use  in  deciding  what  organizing  principle  to  use  for 
producing  either  the  final  answer  or  an  intermediate  product  to  be  plugged  in 
at  a  higher  level  in  the  hierarchy. 

Output . 

Is  this  the  top  level,  producing  the  final  answer?  Yes  _  No  _ . 

If  so,  what  are  the  units  of  the  final  answer?  _ . 

What  is  its  range?  Low _ High _ . 

If  this  is  not  the  top  level,  then  the  output  of  this  organizing 
principle  will  be  input  for  an  organizing  principle  at  a  higher  level. 

What  organizing  principle  is  used  at  the  next  higher  level?  . 

What  kind  of  input  does  it  require?  Units  _ . 

Range:  Lowest  point  _ ,  Highest  point  _ J 

Does  it  need  to  have  a  natural  0?  . 

Input. 

List  the  input  dimensions: 


Organizing  Principle . 

What  organizing  principle  do  you  want  to  use  here?  (Refer  to  Sheet  2  for 
guidance  in  your  choice,  and  to  the  Forms  2-i  and  2-g  that  you  used  to 
describe  these  dimensions  to  see  what  kinds  of  interaction  they  have  with  each 
other . ) 

Check  one:  Averaging  .  Multiplying  _ .  Table  (Configural)  . 

Other 
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APPENDIX  B 

Derivation  of  Measures  of  Achievement ,  Knowledge ,  and 
Cognitive  Control  from  the  Lens  Model 

The  Lens  Model 

Achievement  can  be  decomposed  into  several  components  by  means  of  the 

Lens  Model  Equation  (Hammond,  et  al.,  1975)  as  follows: 

ra  "  G  %  Rs  +  1  '  V  J  '  ~ 

where 

ra  *  achievement,  the  correlation  between  the  engineer's 
judgments  and  criterion  values 
G  “  the  correlation  between  judgments  and  criterion  values 
corrected  for  attenuation  due  to  less  than  perfect 
linear  predictability  in  each 
R£  -  predictability  (linear  form)  of  criterion  from  cues 
Rs  *  predictability  (linear  form)  of  subject's  judgments 
from  cues 

C  “  correlation  between  residuals  from  linear  predictions 
of  criterion  and  residuals  from  linear  predictions  of 
subject's  judgments. 

The  Lens  Model  for  capacity  judgments  is  a  variant  of  this. 
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In  the  capacity  judgment  task,  the  environmental  model,  derived  from  the 
Highway  Capacity  Manual  (Highway  Research  Board,  1965),  involves  nonlinear  cue 
use,  while  the  engineer's  judgments  are  fit  with  a  linear  model.  Since  the 
models  are  different,  it  cannot  be  assumed  that  the  residuals  of  one  model  are 
uncorrelated  with  the  predictions  of  the  other.  There  must  now  be  four  terms 
in  the  lens  model  equation  (Stewart,  1976,  pp  114,  115).  Thus: 


r  -  G  R  R  +  r(Y  ,Z  )  R  </(  1-R  ) 

a  es  ese  s 


+  r(sL»*J  vOI-R  2)  R  +  C  vm-R  2)  v^(1-R  2) 
e  s  es  e  s 


However,  since  environmental  prediction  is  perfect  (due  to  the  fact'  that  the 


capacity  criterion  was  produced  by  the  environmental  model,  from  the  cue 

/ - T~ 

values),  R  m  i  and \/{  1-R  )  ■  0,  so  two  terms  drop  out  of  this  equation, 

e  e 

leaving  the  formula 

r  -  G  R  R  +  r(Y  ,Z  )  R 

a  e  s  ese 


Most  previous  work  with  the  Lens  Model  (and  judgment  research  in  general) 
has  involved  linear  models  of  the  environment.  Therefore  it  is  of  Interest  to 

i 

see  how  closely  the  nonlinear  criterion  can  be  predicted  by  a  linear  model 
involving  the  cues  that  were  available  to  the  engineer— -the  7  cues  used  in 
creating  the  criterion  as  well  as  the  measures  of  (a)  intersections  per  mile 
and  (b)  average  speed  limit,  which  were  made  available  to  the  engineer  during 
his  judgments  in  all  three  modes. 
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Regressing  the  capacity  criterion  onto  these  9  cues  accounts  for  95%  of 
its  variance,  leaving  only  5%  that  is  uniquely  due  to  the  nonlinearities  in 
the  capacity-estimating  procedure.  Hence  the  beta  weights  from  this  formula 
provide  a  reasonable  approximation  of  the  relative  importance  of  the  9  cues  in 
the  prediction  of  capacity  (see  Table  3).  The  two  dimensions  that  were  not 
involved  in  the  production  of  the  criterion  played  relatively  small  roles  in 
predicting  it,  as  would  be  expected.  The  intercorrelations  among  the  nine 
cues  and  the  criterion  are  presented  in  Table  3. 

Knowledge  and  Cognitive  Control 


In  the  absence  of  significant  correlations  between  residuals  (trivial 

values  of  C  in  the  above  equation)  then  r  -  g  R  R  .  Under  these  conditions 

a  e  s 

G  represents  the  engineer's  knowledge  because  it  indicates  what  the  subject's 
achievement  would  have  been  if  he  had  executed  his  judgment  policy  with 
perfect  cognitive  control  (i.e.,  R^  -  1.00)  and  if  the  environmental  task 
criterion  were  perfectly  predictable  from  the  cues  (i.e.,  R#  m  1.00). 

Cognitive  control  (Hammond  and  Summers,  1972;  Hammond  et  al. ,  1975}  is 
appropriately  measured  by  R^  in  the  equation  (and  thus  used  in  the  CCI)  since 
there  was  little  evidence  in  this  study  of  lack  of  fit  of  the  linear  model  in 
either  the  intuition-inducing  film  strip  presentation  or  in  the 
quasi-rationality-inducing  bar-graph  presentation.  Xn  the  analysis-inducing 
formula-construction  situation,  however,  it  is  important  to  note  that  the 
engineers'  analytical  judgments  are  produced  by  formulas;  there  is  no  "error" 
in  the  sense  of  random  variation  about  a  policy,  as  occurs  in  the  intuitive 
and  quasi-rational  modes,  because  the  formula  produces  the  answers 
deterministically.  Thus,  in  the  analytical  mode,  Rs,  the  measure  of  cognitive 
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control,  equals  1.0,  and  G,  the  measure  of  knowledge,  differs  from  r&  only 
because  of  Re#  the  environmental  unpredictability— a  factor  that  is 
independent  of  the  engineer's  behavior. 

Using  R  to  measure  cognitive  control  thus  ignores  the  fact  that  errors 
s 

could  be,  and  indeed  were,  made  by  the  engineers  in  the  analytical  mode. 

Errors  were  made  in  constructing  formulas,  rather  than  errors  in  executing 
judgments ♦  The  measures  of  cognitive  consistency  in  the  Lens  Model  Equation 
do  not  take  account  of  this  type  of  error. 

A  subject's  cognitive  control  in  the  analytical  mode  can,  however,  be 
ascertained  by  a  careful  review  of  his  verbalized  intentions  (transcribed)  of 
what  his  formula  should  be  and  the  formula  he  actually  constructed.  This  step 
results  in  two  formulas  for  each  engineer:  the  one  presented  to  the 
researcher,  the  other  constructed  by  the  researcher  to  reflect  the  engineer's 
intentions.  The  correlation  between  the  answers  produced  by  these  two 
formulas  provides  a  measure  of  the  discrepancy  between  what  was  Intended  and 
what  was  executed;  thus  it  is  a  measure  of  cognitive  control  comparable  to 


the  measure  employed  in  the  intuitive  and  quasi -rational  modes 


Second  Direct  Comparison  -  Appendix  C 
Hammond,  Hamm,  Gras si a  and  Pearson 

APPENDIX  C 
Capacity  Formula 

Two  methods  for  determining  the  vehicle-carrying  capacity  of  a  section  of 
highway  are  given  in  the  Highway  Capacity  Manual  (Highway  ReseArch  Board, 
1965).  Because  both  of  these  methods  are  in  cossnon  use  and  are  accepted  in 
courts  of  law,  their  average  was  used  as  the  criterion  in  our  analysis.  They 
differ  in  how  they  account  for  the  effect  of  hills  on  the  highway's  capacity 
<—  one  uses  information  about  the  average  grade,  given  in  terms  of  the  general 
terrain  the  road  traverses,  and  the  other  takes  a  "bottleneck"  approach  and 
considers  the  effects  of  the  steepest  grade  encountered  in  the  stretch  of 
highway.  Both  methods  take  into  account  lane  width,  lateral  clearance  to  the 
nearest  obstruction,  the  number  of  sides  that  obstruction  is  on,  and  the 
traffic  mi::,  i.e.,  the  percentage  of  trucks.  The  first  method  additionally 
takes  into  account  the  terrain  (categorized  as  plains,  rolling  or  mountainous, 
with  the  categorization  determined  by  the  average  grade);  the  second  method 
additionally  uses  measures  of  the  length  and  angle  (measured  in  percent  rise, 
i.e.,  the  tangent)  of  the  steepest  grade. 

These  methods  are  embodied  in  tables  in  the  Highway  Capacity  Manual  which 
are  based  on  a  large  body  of  empirical  research  by  traffic  engineers. 

The  capacity  procedures  in  the  Highway  Capacity  Manual  predict  the 
capacity  with  the  formula: 

C  -  2000  *  W  *  i 
c  *c 

where  Wc  and  Tc  are  determined  by  tables.  In  both  the  Terrain  and  Steepest 
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Grade  procedures,  is  given  by  a  table  which  is  well  fit  by  the  following 
formula : 

W  «  1.64  -  0.256*LWIDTH  +  0.0159*LWIDTH2  +  0. 0012*LWIDTH*LATCLEAR 
c 

-  n.00918*J.>»IDTH*SIDEOBS  +  0 . 000523*LWIDTH*LATCLEAB*SIDEOBS2 

In  the  Terrain  procedure,  T  is  given  by  a  table  which  is  well  fit  by  the 

c 

following  formula: 

Tc(terr)  "  °'-86  "  0.00817*TERRAIN2*TRAFMIX 
-  0.00041*TERRAIN*TRAFMIX2 
♦  0. 000365*TEP-RAIN2*TRAFMIX2 

In  the  Steepest  Grade  procedure,  T  is  given  by  the  formula: 

c 


T 

c(sg) 


900 


100  -  TRAFMIX  +  £t*TRAFMIX 


where  is  defined  by  a  table  which  is  well  fit  by  the  following  formula: 


Efc  -  -  10.355  -  11. 833*LSGRAD£  ♦  4.161 *ASGRADE 

+  7 • 449*ASGRADE*LSGRADE  +  0 . 7 05 *LSGRADE  *ASGRADE  2 
-  0.286*ASGRADE2*LSGRADE2 


Thus,  when  we  take  the  mean  of  the  Terrain  and  Steepest  Grade  capacities,  the 
capacity  used  in  this  study  is  expressed  by  this  formula: 


-  2000*W  * ( (T  ,+T  ,  .) 

c  -_si£s££i— sisal 


2 
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The  fact  that  the  Highway  Capacity  Manual  is  currently  under  revision 
would  suggest  that  these  are  not  perfect  measures;  however,  they  were  the 
standard  in  effect  at  the  time  the  study  was  done. 
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